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a single imaging detector at the distal tip of the endoscope and a means for digitally processing said images to generate a final, 
Q false-color image for display which indicates regions of tissue dysplasia. This system can either be added on to an existing video 
J> endoscope or integrated into its structure. The combined system can be electronically switched between normal white light imaging 
^ and fluorescence imaging. 
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AUTOFLUORESCENCE IMAGING SYSTEM FOR ENDOSCOPY 

GOVERNMENT SUPPORT 

This invention was supported in whole or in part by a grant from the 
National Institute of Health, Grant No. R44CA72626, "Imaging Spectrofluorimeter 
5 for Colonic Dysplasia". The Government has certain rights in the invention. 

RELATED APPLICATION 

This is a continuation-in-part application of U.S. Application No. 
09/362,806, filed July 28, 1999 which is a continuation-in-part application of U.S. 
Application No. 09/238,664 filed on January 26, 1999, the entire contents of the 
10 above applications being is incorporated herein by reference. 

BACKGROUND OF THE INVENTION 

Advanced stage cancers are difficult to treat effectively, so it is important to 
detect them in their premalignant stages, such as dysplasia or carcinoma in situ. 
Currently, the most widely used method for early detection uses visual inspection 

15 through endoscopes, which relies upon the recognition of the gross architectural 

changes associated with dysplasia. Visual inspection is less effective in detecting the 
superficial lesions of flat dysplasia, such as ulcerative colitis and Barrett's 
esophagus. In these cases, surveillance requires the selection of representative sites 
for biopsy and subsequent histological analysis. Only a very small fraction of a large 

20 surface, such as the colon, can be surveyed in this manner and small areas of 
dysplasia may go undetected. More efficient methods for detecting flat dysplasia 
would provide a significant means of reducing cancer morbidity, mortality, and 
costs. 
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A promising technique for detecting dysplasia during endoscopy involves 
illuminating the tissue with light of an appropriate wavelength and observing the 
resulting fluorescence. Tissue fluorescence occurs at longer wavelengths than the 
excitation illumination and is typically much weaker, so that spectroscopic 

5 techniques are generally required for its detection. Diagnostic methods which use 
fluorescence information can generally be divided into two groups. The first group 
of methods observes fluorescence from medications administered to the patient 
which have accumulated in tumor tissues. The second group of methods observes 
endogenous fluorescence or autofluorescence arising from substances natural to the 

10 tissue itself which change their relative concentrations when the tissue becomes 
dysplastic. Of the two general fluorescence methods, the first method, requiring a 
prior application of a drug, is the more invasive. The application of these drugs takes 
additional time and has the potential of causing adverse side effects. Methods based 
on autofluorescence detection are less invasive and more suited to endoscopy for 

15 screening purposes. 

Normal colon tissue, for example, when illuminated with ultraviolet light at 
370 nm, exhibits a broad, blue fluorescence with a peak at 450 nm, as shown in 
Figure 1 . This fluorescence is due to collagen, the primary protein of connective 
tissue, which is found within the thin mucosal layer and which is the dominant 

20 component of the submucosal layer. The fluorescence of dysplastic colon tissue, due 
to changes in its structure and chemistry, is typically l A to 1/3 as intense given the 
same illumination. This reduction in visible blue-green autofluorescence, produced 
by ultraviolet to violet excitation light, has been identified as a primary indicator of 
dysplastic tissue. An increase in the relative fluorescence at 680 nm compared to 

25 600 nm is a secondary indicator of dysplasia. 

Diagnostic instruments which detect autofluorescence can be divided into 
two general groups. The first subdivision includes instruments which utilize 
fiberoptic probes to perform essentially point measurements on the tissue. The 
second subdivision includes instruments which produce detailed, two dimensional 

30 images. Point detection instruments have the advantage of providing more complete 
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spectral information on the tissue, but are too slow for routine screening of large 
tissue areas and may miss small regions of dysplasia. Fluorescence imaging 
endoscopes are more appropriate for screening large tissue areas such as the colon. 
Fluorescence imaging systems designed to sense concentrations of 

5 fluorescent markers that have been applied to the region of interest are optimized for 
the measurement of relatively high fluorescence levels, do not describe the 
additional instrumental features required to measure inherently weak 
auto fluorescence. In particular, they do not describe a method for providing 
sufficient out-of-band filtering for the excitation illumination that would allow the 

1 0 effective measurement of autofluorescence, which typically is reduced in intensity, 
compared to the excitation intensity, by a factor of 1000 or more. 

Fluorescence imaging endoscopes which are specifically designed to 
measure autofluorescence can be further divided into groups based on the excitation 
wavelength chosen and the method for quantifying the degree to which the 

1 5 autofluorescence is reduced. These design choices have a direct bearing on 

commercial considerations for the instrument since they affect, for example, the 
number of imaging devices required, the opto-mechanical complexity of the 
instrument, and the handling characteristics of the instrument in actual use. 

Existing fluorescence imaging endoscope systems use visible blue light near 

20 440 nm for the excitation wavelength, resulting in fluorescence peaks around 500 
nm. These instruments use Helium-Cadmium lasers at 442 nm as a bright, easily 
controlled source for the excitation light. The high cost of Helium-Cadmium lasers 
makes them impractical as sources for commercial instruments. 

Multiple cameras and mechanically switched optical components and/or 

25 filters require the use of endoscopes based on coherent imaging fiber bundles, so 
that the cameras and filters can be located at the proximal end of the endoscope 
where there is room for them. The coherent fiber imaging bundles introduce 
significant light losses and do not provide as sharp an image as those now available 
with video endoscopes. 
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SUMMARY OF THE INVENTION 

The present invention relates to imaging endoscopes and in particular to an 
endoscope system and method for imaging autofluorescence from epithelial tissue to 
highlight regions of dysplasia. The system for detecting dysplastic tissue uses the 
5 autofluorescence of mucosal tissue such as that found in the colon, the esophagus, 
the oral cavity, the cervix and the lung. The fluorescence imaging apparatus for an 
endoscope of the present invention utilizes a selected range of excitation light 
wavelengths and a fluorescence normalization method. These choices provide for an 
improved endoscope which requires one, non-intensified, imaging detector at the 

10 distal tip of a video endoscope for both white light imaging and fluorescence 

imaging. The imaging detector can be a pixilated integrated circuit device such as a 
CMOS imaging device, charge coupled device (CCD) or other small two 
dimensional imaging sensors that can detect in the visible and infrared ranges. 

The system of the present invention has the ability to switch back and forth 

1 5 between white light and fluorescence visualization methods electronically, requiring 
no moving parts within the endoscope itself The elimination of cameras and 
imaging optics at the proximal end of the endoscope significantly improves its 
handling characteristics. A computer-based imaging system allows quantitative 
images of the tissue to be displayed, at refresh rates of up to 10 Hz or higher, for 

20 example. A preferred embodiment uses easily seen, false-color overlays which 
indicate the likely areas of tissue dysplasia. By "false color" we mean that a color 
value is assigned to a particular level of fluorescence intensity for each pixel. A data 
processing system can be programmed to provide a color system suitable for 
imaging a given type of tissue condition. The system can be used either with color 

25 wheel (e.g., using a monochrome CCD) video endoscopes or with color imaging 
sensor endoscopes. 

In a preferred embodiment, near ultraviolet light is chosen as the excitation 
wavelength, as described in Wang, et al., US Provisional Application No. 
60/072,455, January 26, 1998. This choice in the range of 300-420 nm reduces or 

30 eliminates the need for additional filters between the tissue and the imaging detector 
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due to the fact that standard, electronic imaging sensors, as used in video 
endoscopes, are insensitive to the excitation light. Visible red light, to which the 
imaging detector is very sensitive, is chosen to illuminate the tissue for the purpose 
of acquiring a reference image. This reference light is passed through the same 
5 optical guide as the excitation light, and illuminates the tissue with the same 

normalized spatial distribution and angular distribution as the excitation light. By 
correlating the spatial intensity and angular distribution of light used for the 
reflected image and the light for the fluorescence image, a more accurate and 
diagnostically useful imaging system is provided. This system of the present 
10 invention allows the reference image to be used to normalize the fluorescence image 
so that local reductions in fluorescence intensity can be accurately quantified. In 
another preferred embodiment, using color wheel (monochrome CCD) video 
endoscopes, the reference light and excitation light are applied sequentially. In 
another preferred embodiment, using color CCD video endoscopes, the fluorescence 
1 5 excitation light and reference light are applied simultaneously. 

An additional reference image can be taken using a third color channel of the 
video colonoscope. The reference light directed onto the tissue for this image is 
predominately blue in color, with a central wavelength and bandwidth which 
approximates the fluorescence spectrum induced by the UV excitation light. The 
20 ratio B/R of this blue reference image, B, to the red reference image, R, on a pixel- 
by-pixel basis, identifies areas of the imaged tissue where chemical species 
(predominately hemoglobin) absorb some of the intrinsic fluorescence before it can 
exit the tissue and be imaged. The acquisition of the ratio F/R of the fluorescence 
image, F, to the red reference image, R, consequently provides two parameters, F/R 
25 and B/R, that can be used on a pixel-by-pixel basis for determining whether 
abnormal tissue such as dysplasia is present in the imaged region of interest. 
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BRIEF DESCRIPTION OF THE DRAWINGS 

Figure 1 is an illustration of the fluorescence spectrum of normal and 
dysplastic colon tissue due to excitation with UV light at 370 nm. 

Figures 2a and 2b are diagrams of the fiberoptic delivery probe system in 
5 accordance with the present invention. 

Figure 3 is a schematic diagram of an embodiment of the fluorescence 
imaging endoscope of the present invention which uses a separate fiberoptic light 
guide to deliver the UV excitation light through a biopsy channel of a color- wheel 
(monochrome CCD) video endoscope. 
1 0 Figure 4 is a flow chart for the production of the output image. 

Figure 5 illustrates a timing diagram for the image acquisition, analysis and 
display process in accordance with the present invention. 

Figures 6a - 6c illustrates the UV output from a mercury arc lamp as a 
function of pulsed current in accordance with the present invention. 
1 5 Figure 7 is a schematic diagram of a computer-controlled, pulsed lamp 

power supply in accordance with the present invention. 

Figures 8a - 8d illustrate the details of opto-mechanical elements of the 
pulsed light source in accordance with the present invention. 

Figures 9a - 9c illustrate the construction of the optical delivery fiber used in 
20 accordance with the present invention. 

Figures 1 0a - 10b are schematic diagrams of a preferred embodiment of the 
imaging system which uses a separate fiberoptic light guide to deliver the UV 
excitation light through a biopsy channel of a color CCD video endoscope. 

Figure 1 la - 1 Id are schematic diagrams of a preferred embodiment of the 
25 imaging system which integrates the UV-transmissive illumination guide into the 
endoscope and connects an external UV excitation source to a standard white light 
source with an adapter module. 

Figure 12 is a schematic diagram of a preferred embodiment of the imaging 
system which fully integrates the excitation light source and white light source into 
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an illumination system for an endoscope fitted with UV-transmissive illumination 
guide.. 

Figures 13a and 13b illustrate another preferred embodiment of an 
illumination and collection endoscope imaging system. 
5 The foregoing and other objects, features and advantages of the invention 

will be apparent from the following more particular description of preferred 
embodiments of the invention, as illustrated in the accompanying drawings in which 
like reference characters refer to the same parts throughout the different views. The 
drawings are not necessarily to scale, emphasis instead being placed upon 
10 i 1 lustrating the principles of the invention. 

DETAILED DESCRIPTION OF THE INVENTION 

The present invention relates to systems and methods for imaging 
autofluorescence from epithelial tissue to highlight regions of dysplasia. The tissue 
autofluorescence imaging system in accordance with the present invention improves 

1 5 upon the previous state of the art in that, in its simplest form, it can be added on to 
an existing video endoscope system with no modifications to the endoscope itself, 
and with only the addition of a shutter in the optical path of the endoscope's visible 
light source. The handling characteristics of the endoscope are thus not adversely 
affected by the addition of image intensifies and external cameras at the proximal 

20 end as required by fluorescence imaging systems currently on the market. Switching 
between normal visible light imaging, in full color, and fluorescence imaging is 
accomplished by an electronic switch rather than a physical manipulation by the 
clinician, also required by current systems. The resulting fluorescence video image 
is processed by a computer so that the diagnostic image seen by the clinician 

.25 consists of a familiar visible light image (in gray scale) with a false color overlay 
indicating those areas in the image where the fluorescence from the tissue is reduced 
in comparison to the fluorescence from normal tissue. This image is much easier to 
interpret than the combined red/green raw fluorescence images provided by current 
systems, particularly for red/green color-blind clinicians. 
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The system of the present invention uses only a single imaging detector at 
the distal end of the endoscope for acquiring normal color images, fluorescence 
images and visible reference images. The use of a camera at the distal end is made 
possible by using fluorescence excitation light at ultraviolet to deep violet 

5 wavelengths to which the CCD camera is insensitive or can be made insensitive 
using a fixed filter. This allows broadband collection of the resulting tissue 
autofluorescence from blue to red wavelengths, resulting in sufficient light for 
effective video signals without the need for additional image intensification. 
Fluorescence imaging in this fashion has been described in-vivo by Wang, et al. as 

1 0 described in U.S. Application No. 09/238,664, entitled "Fluorescence Imaging 

Endoscope" filed on January 26th, 1999, the entire contents of which is incorporated 
herein by reference. 

Previous autofluorescence imaging systems have depended upon imaging 
very weak fluorescence at red wavelengths to provide an image to compare with the 

1 5 fluorescence image taken at blue-green wavelengths. Additional image 

intensification is particularly necessary to provide a usable red fluorescence images. 
The autofluorescence imaging system and method of the present invention avoids . 
this expense and difficulty by supplying additional visible red light illumination to 
the tissue for the purpose of obtaining a reference image. To be effective, however, 

20 the UV excitation light and the visible reference light must be delivered to the tissue 
through a common optical guide and exit the same illumination aperture with the 
same angular distribution. This requires a careful design of the excitation and 
reference light source optics. The processing of the reference image includes other 
features, such as histogram analysis, to eliminate artifacts such as visible specular 

25 reflections which do not occur in fluorescence images. 

The combination of the system features in accordance with the present 
invention can be realized in several different ways, depending upon the endoscope 
with which the autofluorescence imaging system is combined. Some of these 
features can also be built into the endoscope itself in stages as the technology is 

30 accepted by clinicians. 
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In a preferred embodiment, the excitation illumination and reference 
illumination are generated by the same arc lamp source and delivered to the tissue 
through the same fiberoptic probe passed through a biopsy channel of the 
endoscope. In other embodiments the excitation light can be generated with a 
5 stand-alone source but delivered to the tissue through UV-transmissive illumination 
bundles built into the endoscopes as replacements to the standard, UV-absorbing 
glass bundles. The reference illumination is derived from the normal white light 
illumination source by switching in a red-pass filter that absorbs light at blue and 
green wavelengths which can interfere with imaging the predominately blue 
10 fluorescence. A deep red light source or near infrared (e.g., at 670 nm or above) can 
be used without affecting the normal visible illumination and can be combined with 
a dichroic element for delivery along a common optical path. In further 
embodiments, the excitation light source can be combined with the standard, white 
light illumination source and delivered to the tissue through an endoscope with 
15 UV-transmissive fiberoptic illumination bundles. A rotating wheel light source can 
also be modified to produce four colors, ultraviolet, blue, green and red, to perform 
both the fluorescence imaging and the visual imaging. 

Figures 2a and 2b show the general components of a preferred embodiment 
in which the excitation light and the visible reference light are delivered to the tissue 
20 through a separate fiberoptic probe. The fiberoptic probe 200 is -passed through a 
biopsy channel of a standard video endoscope 202 with its tip finally placed at or 
near the distal tip of the endoscope 204. When a footswitch 206 is depressed by the 
clinician, the normal white light illumination from the endoscope's light source and 
video processor 208 is switched off with a shutter. This white light normally 
25 illuminates the tissue through the two fiberoptic illumination ports 210 and 212 on 
the distal tip of the endoscope. Simultaneously, a complementary shutter in the 
excitation and reference illumination source 214 is switched on so that excitation 
and reference light can pass through the fiberoptic probe 200. The excitation and 
reference light exits the tip of the fiberoptic probe 216 and illuminates the tissue 
30 218. The video image detection system 220 transmits the resulting fluorescence 
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image signal and reference image signal back through the endoscope 202 to the 
video processor 208 where they are converted into different color channels R and B) 
in a standard R,G,B National Television Standards Committee (NTSC) video 
format. These two channels are digitized with a video framegrabber in the computer 

5 system 222. The digitized fluorescence and reference images are processed together 
in real time to quantify image regions where the fluorescence is reduced compared 
to normal tissue. Reduced fluorescence is the primary indicator of dysplasia. Areas 
of the tissue which are likely to be dysplastic are highlighted with false color in a 
processed image of the tissue which is displayed on a computer monitor 224 and 

10 updated at a rate of up to 10 Hz. The preferred embodiment shown in Figures 3a and 
3b is thus an add-on component to an existing endoscope/ video processor system 
which only requires the addition of an internal shutter to the white light source in the 
endoscope systems video processor. For color-wheel (monochrome CCD) video 
endoscopes, the excitation light source 214 is constructed to provide sequential 

1 5 excitation and reference illumination as described in more detail hereinafter. For 
color-CCD video endoscopes the excitation light source 214 provides simultaneous 
excitation and reference illumination, also described in more detail hereinafter. 

The auto fluorescence imaging system demonstrated by Wang, et al. used an 
argon-ion laser as a UV excitation source. Other laser sources can be used including 

20 solid state lasers, such as gallium nitride laser diodes, operating at wavelengths in 
the range of 380 nm to 420 nm, which have smaller size and low power operation. 
The systems in accordance with the present invention uses a mercury arc lamp as a 
source of UV excitation with a spectral band around the 365 nm mercury line. The 
mercury arc source is smaller, and less expensive than the argon-ion laser, requires 

25 relatively little power and is air-cooled. For the autofluorescence imaging systems 
used with color wheel (monochrome CCD) video endoscopes, the current to the arc 
lamp can be pulsed. In the color wheel video systems, the normal light source 
provides red, green and blue light pulses sequentially during a 33 ms video frame 
which are combined with the video processor to provide a color image. In the 

30 autofluorescence imaging mode these systems replace the normal blue light pulse 
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with a UV pulse and the green light pulse with a (nominally red) reference light 
pulse transmitted through the same optical fiber as the UV pulse. By pulsing the arc 
lamp current for the 8 ms period that the blue light is normally on, the UV source 
can provide as much or more excitation fluence to the tissue than it could if the CW 

5 lamp intensity was integrated over the full 33 ms video frame period. 

With both color wheel video systems and color CCD video systems the 
autofluorescence imaging mode is initiatedwith a footswitch which controls 
complementary shutters on the excitation/ reference light source and the normal 
endoscope white light source. Shutting off the normal endoscope illumination is 

10 required in order to image the weak fluorescence from the tissue. Two different 
autofluorescence imaging modes can be used. In one mode, a single frame of the 
false color overlay from the processed autofluorescence image is combined with the 
immediately preceding (or following) color image and frozen on the computer 
screen. In the second mode the processed fluorescence image is updated 

1 5 continuously (at about 7.5 Hz to 10 Hz allowing for the image processing time) for 
as long as the footswitch is depressed. In the continuous operation mode the visible 
image is shown as a gray scale (since it is taken with a monochrome reference 
illumination) with false color overlays showing regions of likely dysplasia. 

Figure 3 shows an overall schematic diagram of a preferred embodiment of 

20 the fluorescence imaging system for use with color wheel (monochrome CCD) video 
endoscopes. For normal mode of operation of the color wheel video endoscope, the 
distal tip of the endoscope 300 is inserted into the hollow organ of the body to 
observe an area of tissue 302 which may contain a region which is dysplastic 304. 
The CCD imaging device and lens, subsystem (the video camera) 306 is flanked on 

25 either side by the normal illumination apertures 308 and 310. 

The normal illumination light is carried by a fiberoptic bundle 312 which 
extends through the length of the endoscope and bifurcates near its distal tip, 
terminating at apertures 308 and 3 1 0. A shutter 3 1 4 between the illumination source 
and the fiberoptic bundle, controlled by a digital signal 315, allows the white light 

30 illumination to be turned off without turning off the source lamp 3 16. In the type of 
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endoscope shown, the normal color image is obtained by combining three, 
successive images taken with red. green and blue light pulses provided by a rotating 
filter wheel 318. The CCD detector in this type of endoscope is sensitive to all 
wavelengths between 400 nm and 700 nm, but is insensitive to UV excitation 

5 wavelengths around 365 nm which are used to excite the autofluorescence. This is 
due both to the design of the silicon sensor array and to the choice of optical 
materials used to physically protect the surface of the array. The CCD detector 
continuously integrates all of the light which falls on its surface so the illumination 
must be shuttered off while the CCD rows are shifted down to the readout 

10 electronics or else a streaking effect will be seen on the image. The red, green and 
blue light pulses have a duration of about 6 ms followed by a dark period of 5 ms 
during which the camera pixels are read out, yielding a total video frame period of 
about 33 ms or 29.97 frames per second to meet the NTSC standard. The analog 
readout signal from the CCD camera is carried through a cable 320 to the endoscope 

1 5 video processor 322. 

The three successive monochrome images are digitized and combined into a 
standard color video signal at the end of the video frame. The processor has two 
groups of standard red, green, blue (RGB) plus synchronization outputs. One output 
group of color signals 324 goes to the endoscopes video monitor 326 to display the 

20 normal color image of the tissue 328. Another group of color signals 330 goes to a 
video framegrabber 332 in the fluorescence imaging computer system 334 which 
will acquire and process the autofluorescence and reference images. A standard 
composite color signal output 336 from the video processor goes to a 
synchronization circuit 338, based on a National LM1881 Video Sync Separator. 

25 This synchronization circuit 338 determines when the interlaced even and odd fields 
occur in the video signal and outputs a binary digital signal 340 which is high during 
the odd field and low during the even field. This signal 340 is used throughout the 
fluorescence imaging system to synchronize its functions to the timing set by the 
endoscope's video processor. 
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To engage the auto fluorescence imaging mode of operation, the clinician 
depresses footswitch 341 which sends a signal on cable 342 to the computer 334. At 
the appropriate time, synchronized to the next opportunity as determined by the 
synchronization signal 340, a signal is sent out on the shutter trigger line 3 1 5 to 

5 shutter 3 14 on the normal illumination source and the shutter 343 on the excitation/ 
reference light source. These shutters are complementary, so that the signal on line 
315 opens shutter 343 and simultaneously shuts shutter 314. The excitation and 
reference light pulses, generated by the rotating shutter wheels in the optical group 
350, then pass into the fiberoptic probe 344. Probe 344 is inserted into a biopsy 

10 channel opening 345 and slid down the channel until its end window 346 is either at 
or just beyond the distal tip of the endoscope 300. The excitation and reference light 
pulses illuminate the central portion of the endoscope's visual field. The angular 
extent of the illumination depends on optical elements 350, the fiber numerical 
aperture, and the optical characteristics of the fiberoptic probe end window 346. 

1 5 The excitation and reference light pulses must occur during two of the three 

normal illumination pulse periods for the autofluorescence and reference images to 
be properly acquired. These images appear on the next video output frame on two of 
the three video output channels from the endoscope video processor. The appropriate 
timing is accomplished by rotating shutters 352 and 354 in the excitation (UV) and 

20 reference (RED) light paths, respectively, of the optical group 350. The shutters are 
driven by direct current (DC) motors 356 and 358 which rotate at a speed which can 
be controlled by varying their supply voltage. A fiducial hole near the rim of the 
shutters, combined with an optical source and detector, generates a reference pulse 
for each which marks its phase as it rotates. A phase-locked loop (PLL) 362 and 360 

25 for each motor, 358 and 356, respectively, adjusts the motors voltage so that the 
reference pulse for each matches the rising edge of the synchronization pulse 340 
marking the beginning of the odd video field. 

By positioning the hole in the shutters appropriately the excitation light pulse 
and the reference light pulse can be timed to the exposure periods of the camera. The 

30 excitation pulse is timed to match the normal blue exposure since this exposure 
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period is somewhat longer (8.1 ms) than the others. The reference light pulse is 
timed to match the normal green light exposure (5 ms) since it is the next longest of 
the normal exposure periods. The normal red exposure period, which immediately 
follows the normal blue exposure period, is not currently used, but can be employed 
5 to obtain additional autofluorescence or reference images or an additional visible 
reflectance image for other spectroscopic analyses. During the excitation exposure 
the current to the mercury lamp can be boosted to a higher level to increase the 
excitation light output. The lamp power supply utilizes a DC current section 366 to 
maintain the idle current and start the lamp. 

10 A computer-controlled, pulsed current section 368, connected in parallel with 

the DC section 366, can rapidly switch in multiple, parallel-coupled, 
constant-current sources to vary the output power of the lamp as required by the 
imaging system. The current pulses are synchronized to the video system using the 
same synchronization pulse 340 that serves to lock the rotating shutters. The 

15 computer digital input/output (I/O) section 370 outputs a digital pulse 372 which is 
combined with the timing pulse 340 to boost the lamp current during the excitation 
exposure. The number of constant current sections which are triggered in parallel 
can be varied by a set of digital control lines 374 as required. If the tissue is 
sufficiently close to the excitation/ reference delivery probe window 346 then no 

20 boost may be required. If the peak value of the autofluorescence image drops to a 
minimum acceptable level, as determined by the computer image analysis program 
376 as monitored by the overall control program 378, then additional current boost 
sections are enabled as required for the next exposure. 

Once the autofluorescence image and the reference image have been 

25 acquired by the digital framegrabber in the computer then the analysis can begin. A 
reflectance (non-fluorescing) image taken with an endoscope camera system 
measures the brightness of the tissue surface in its field of view. To the extent that 
the tissue surface is a Lambertian (non-specular) reflector, the reflectance image 
signal (as digitized by the video framegrabber for each discrete pixel in the video 

30 image) is proportional to distance of the tissue from a single illumination source (or 
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a weighted distance from multiple sources), and to the integrated energy of the 
excitation illumination during that video frame. The end window 346 of the 
excitation/ reference delivery probe is not in the direct line-of-sight from the camera 
lens to the tissue so there will be visible shadows. A reflectance image can thus be 

5 used to measure the excitation illumination at the tissue surface visible to the 

camera, including the presence of shadows in the autofluorescence image. Note that 
this is only true if the excitation illumination and the visible illumination emanate 
from the same aperture with the same transverse intensity profile and angular 
divergence as provided by the design of the source as described herein above. A 

1 0 visible reflectance image taken with light from the illumination bundles of a 

standard endoscope, for instance, is not acceptable for determining the excitation 
illumination from a separate optical fiber passed through a biopsy channel of that 
endoscope. Note also, however, that the same aperture/ same divergence condition 
can be satisfied by passing both the excitation and the reference light pulses through 

1 5 the illumination bundle of the endoscope. 

The sequence of steps for obtaining a false color indication of dysplasia 
probability using the visible reference image along with the autofluorescence image 
proceeds as follows. The two images are first corrected for the gamma factor applied 
to the video signal by the video processor which is generally connected to a video 

20 monitor rather than a framegrabber. This insures that the digitized images acquired 
by the framegrabber in the computer, are linear functions of the illumination fluence 
(time-integrated intensity). The two images are then normalized to their peaks, 
which is generally a region of non-dysplastic tissue somewhere in the visual field. 
There are a few pixels in the reference image which are saturated due to specular 

25 reflections of the reference illumination. These are effectively eliminated by 

producing a histogram of the reference image and normalizing the image to a peak 
value. This generally includes about 99% of the pixels. 

All normalized reference image pixels above a value of 1 (the specular 
reflections) are then reset to a value of 1 . There are no specular reflections in the 

30 autofluorescence image so such a histogram-based normalization is not necessary. 
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On a pixel-by-pixel basis the auto fluorescence image value is then divided by the 
corrected reference image value to produce a ratio image. This division is performed 
only when the autofluorescence and reference image pixel values are above a 
minimum threshold condition to insure that the analysis is not attempted with too 
5 little illumination to provide a reliable measurement. 

If a ratio image pixel value falls below a predetermined value (typically 
one-half to one-third) then that pixel represents a region of reduced fluorescence on 
the tissue surface which is indicative of dysplasia. The corresponding pixel in the 
processed output image can then be set to a false color state to indicate the relative 

10 probability of dysplasia. If the ratio image pixel value is below 1/3 the red value of 
the corresponding processed output image pixel it is set to the value of the reference 
image and the green and blue values of that pixel are set to zero (it is a shaded red, 
indicating a high probability of dysplasia). If the ratio image pixel value is V% to 1/3, 
then the green value of the processed output image pixel it is set to the reference 

1 5 image value and the red and blue values are set to zero (it is a shaded green, 
indicating a moderate probability of dysplasia). If the ratio image pixel value is 
above Vi then the red, green and blue values of the processed output image pixel are 
all set to the reference image value (it is a shaded gray, indicating the probability 
that the tissue is normal). This processed output image 386 is displayed on an LCD 

20 monitor 384 attached to the system computer 334. 

Figure 4 illustrates a process sequence 400 after a patient has been prepared 
the endoscope inserted into the body cavity or human and the distal end thereof has 
been positioned for imaging of a region of interest. In this particular example, a 
visible reference image is obtained 402. This reference data is corrected 404, a 

25 histogram is generated 406, the data is normalized 408, selected pixels are reset 410 
and a threshold value is applied 412. After a fluorescence image is obtained 420, the 
image is corrected 422, normalized 424, a threshold applied 426, and a ratio image is 
generated 430. The resulting output image or representation is then compared 432 
to a reference, and a given region is determined to be normal 440 or dysplastic 450. 
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Figure 5 shows a timing diagram for one cycle of the imaging process. The 
maximum video output rate is 29.97 Hz as set by the NTSC standard. The diagram 
indicates a system which requires one frame time for acquisition, between two and 
three frame times for analysis, and a fraction of a frame time for transferring the 

5 result to the output image buffer. The resulting update rate for the analysis image is 
7.5 frames per second. With a single, fast processor, the analysis time can be 
reduced and the update rate correspondingly increased to 10 or 15 frames per 
second. The image analysis can also be performed at output rates up to 30 frames 
per second by, for example, using two processors operating in parallel with only a 

10 few frames of delay between acquisition and display. Increased update rates, 

however, require a reduced upper limit on the pulsed current to the lamp in order to 
maintain an average lamp dissipation of no more than 100 W. Figure 5 also shows 
how the mercury lamp current is boosted only during the blue exposure periods 
which result in autofluorescence images. At other times the lamp idles at a reduced 

15 power. 

Figures 6a and 6b show that the UV output power from a 100 W Hg arc 
lamp, pulsed for 8 ms above a 70% idle current, is essentially a linear function of its 
input power to at least a factor of 5 over its nominal rated power. Boosting the lamp 
current during the UV exposure period increases the lamp output power which, in 

20 turn, allows a larger area of tissue to be scanned for dysplasia. It also provides a 
means for adjusting the output of the lamp for an optimum video exposure on a 
pulse-to-pulse basis. Since the lamp discharge maintains a nearly constant voltage 
drop across the arc regardless of current, the lamp output power is essentially 
proportional to current. About 70% power to the lamp must always be maintained, 

25 however, to keep the mercury in the vapor phase. Figure 6c shows that pulsing the 
current to a factor of 5 over the rated CW current can be repeated continuously at a 
rate of 7. 5 Hz. 

Figure 7 shows a block diagram of the lamp power supply as it connects to 
the mercury arc lamp 700. The DC idle current circuit 702 and high voltage (HV) 
30 starting pulse circuit 704 are handled by a single commercial power supply designed 
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for CW 100 W mercury arc lamps. The constant current, triggered pulse circuit 706 
is designed to match the specific requirements of the fluorescence imaging 
endoscope. Four of these circuits are connected in parallel so that the output of the 
arc lamp can be set digitally to one of 5 different power levels (including idle). Each 
5 circuit is composed of a power MOSFET switch which adjusts its resistance to keep 
the passed current at a fixed level, typically equivalent to the normal DC current of 4 
amps. These circuits can be individually triggered by a computer whenever their 
current boost is required to properly illuminate the tissue. Each circuit draws its 
current from a storage capacitor 708 charged by a power supply 710 through a 
1 0 current limiter 712. This limited current design minimizes the possibility of fault 
conditions which could overload the power handling capacity of the arc lamp. 

Figures 8a, 8b, 8c and 8d show details of the excitation/ reference 
illumination source optics. A single mercury arc lamp 800 in Figure 8a is used as the 
source of both wavelengths because both the UV/violet excitation light and the 
1 5 red/near infrared reference light need to have the same apparent source volume 802 
at the distal tip of the endoscope. Small 100 W, mercury arc lamps have arc 
dimensions of 0.5 to 1.0 mm which are small enough to couple efficiently into the 
optical fibers used to deliver the light to the tip of the endoscope. Separate lamps 
can be used for the excitation and reference beams, but the tolerances for the source 
20 optics and the alignment of the source arcs are then more critical. In the preferred, 
single lamp, source design shown in Figure 8a the light collection optic 804 is 
shown schematically as a single, fused silica, UV-transmitting lens. In practice 
either a multiple element lens design or a mirror-based Schwarzschild objective is 
used to reduce optical aberrations on the collected beam. Such collection optics 
25 could also collimate light from the focal volume of a commercial mercury arc lamp 
with a fixed, pre-aligned, elliptical reflector as an alternative source. The collection 
optics 804 collimate the light from the lamp so that it can be effectively filtered into 
UV and visible components by means of a dichroic mirror 806 which reflects UV 
and/or deep violet wavelengths and transmits visible wavelengths. 
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Separation into two paths is required so that two rotating shutters, 808 and 
810, can produce UV excitation and visible reference pulses at different times during 
the video frame as described above. A UV-reflective surface coating on mirror 812 
immediately after the dichroic mirror reflects nearly 100% of the desired UV light in 

5 that path and dumps much of the undesired visible light reflected from the dichroic 
into its substrate. Additional UV filters represented by element 814 may include 
absorptive filters such as Schott UG-1 glass as well as multilayer dielectric bandpass 
filters centered on the 365 nm line of mercury. The UV path rejects visible light to a 
high degree since the efficiency of the 460 nm tissue fluorescence is only about 

10 0.1%. Leakage of visible source light during the UV exposure period reduces the 
contrast of the autofluorescence image. Some correction for such leakage is possible 
during the digital image processing but corrections always add a small amount of 
noise to the result. 

The first element in the reference path is a weak lens 816 to correct for the 

1 5 lower refractive index of the fused silica collimating lens 804 at visible wavelengths 
as compared to the UV. Note that lens 8 1 6 would not be necessary if a 
Schwarzschild objective is used at the position of lens 804 since such a design uses 
only mirrors and is thus totally achromatic. An attenuator can optionally be moved 
into the reference path at position 817 to prevent saturation of the reference image at 

20 close inspection distances. This attenuator must be uniform across the area that the 
reference beam passes through in order to maintain the uniform angular intensity 
distribution required of the reference illumination. This attenuation can be 
accomplished with variable, crossed polarizers, differentially-sliding, linear 
attenuation wedges or electromechanically-switched, fixed-value attenuators. The 

25 visible filter 8 1 8 in the reference beam path is less critical than the UV filter when 
sequential excitation/ reference beams are used such as in the system shown. The 
reference beam wavelength is chosen to avoid hemoglobin absorption bands since a 
significant absorption introduces an error into the analysis which assumes that the 
reference image is equivalent to a measurement of the excitation illumination 

30 intensity. The rotating shutters 808 and 8 1 0 follow the filters. 
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Continuing down the visible path after shutter 808 is turning mirror 820 with 
a broadband visible reflective coating. A second dichroic mirror 822, identical to 
dichroic mirror 806, recombines the UV excitation beam and the visible reference 
beam onto a common path. One additional turning mirror 824 which reflects both 
5 UV and visible light directs the two beams towards the focusing optics 826 which 
couples them into the delivery fiber 828. The turning mirror 824 makes the number 
of reflections in both the UV and visible paths of the system equal. With equal 
numbers of reflections, any change in the position of the mercury arc 802 relative to 
the position of the collection optics 804 results in the same angular deviation for 

10 both the excitation and reference beams. Equal deviation angles preserves the 

overlap of the excitation and reference beams on the tissue. The system as shown in 
Figures 8a - 8c, in which the combined beams exit the optical train in the same 
direction as the incoming beam, also makes the direction of the output beams 
invariant under translations and small rotations of the optical train as a whole. 

1 5 The aperture stop 830 in Figure 8a insures that the UV excitation and visible 

reference beams have the same angular convergence on entering the delivery fiber 
828. The transverse dimensions of the two beams at the position of the focusing 
optic 826 will invariably be slightly different due to small errors in the positioning 
of the optics in the two paths and slight differences in the effective emitting volume 

20 of the arc at the two wavelengths. The aperture stop 830 is set so that both beams are 
slightly clipped at their outside edge, insuring that the maximum angular input to the 
optical fiber is the same for both. Figure 8b shows that, to a great degree, the input 
angle to an optical fiber, relative to the fiber axis, is preserved upon each reflection 
within the fiber. Illumination of a fiber with a collimated beam from a single 

25 direction generally results in a cone of emitted light from the opposite end of the 
fiber which has the same angle relative to the axis. The light is spatially averaged 
over the exit aperture of the fiber but the angles only slowly spread due to bends in 
the fiber as it passes down the length of the endoscope. The embodiment shown 
insures that the normalized angular intensity distribution of the excitation 

30 illumination and the reference illumination are closely matched as required by the 
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autofluorescence normalization method. If, for example, the normalized reference 
illumination locally exceeds the normalized excitation illumination in a region 831 
as shown in Figure 8c, then the analysis falsely indicates reduced autofluorescence 
in this region. If the normalized reference illumination is greater by a factor of two 
5 over the normalized excitation then the analysis provides a false positive indication 
of dysplasia, where the threshold condition is set to 50%. Similarly, if the 
normalized reference illumination is a factor of two below the normalized excitation 
illumination in some region, then the analysis indicates normal tissue even if the 
autofluorescence was actually reduced by the same factor of two in that region. 
1 0 Such large errors are unlikely in the center of the illumination field but can occur at 
the edges of the field where the illumination drops to the noise level. The threshold 
conditions placed on both the reference and autofluorescence images insure that the 
analysis is not attempted where it is too easily influenced by noise or edge effects. 
In general, it is described to maintain any variation in the intensity distribution of the 
1 5 reference light as seen at 860 (normalized) at less than 20% relative to the intensity 
distribution of the excitation light at any point along the optical path between the 
combiner and the tissue surface. It is most important to achieve minimal variation in 
intensity at the tissue surface. Thus light exiting the fiber 862 is within the cone 
defined by the angle 0 and variations in intensity at along the wavefront 864 should 
20 be less than 20% to minimize the risk of false image. 

Figure 8d shows a more detailed view of the rotating shutter design in the 
excitation/ reference source. Each blade rotates once in 33.3 ms, the period of one 
video frame. The angle subtended by the aperture 832 on the excitation shutter blade 
810 corresponds to the 8.1 ms period for the normal blue exposure. The timing of 
25 the UV exposure relative to the video frame is set by the phase-locked loop 

matching the rising edge of the optical pulse through the excitation blade fiducial 
834 to the rising edge of the odd field mark on the synchronization signal 340 as 
shown in Figure 3. The apparent position of the excitation beam in the optical train 
is marked by the dotted circle 836. For the relative dimensions of the beam diameter 
30 to shutter diameter shown the total rise time of the light pulse is 1 .7 ms which is 
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acceptable compared to the total length of the pulse. The blade 810 is thin, light in 
weight and opaque, made from a material such as stainless steel or glass-fiber 
reinforced epoxy. 

Minimizing the moment of inertia simplifies locking the shutter's rotation 

5 rate with the PLL. Being opaque is important to prevent light leakage. The cutouts 
838 around the central hub 840 of the wheels leave thin blade flexures 842 which 
allow the wheel to flex slightly as it rotates to stay perpendicular to the rotation axis 
of the motor, minimizing vibration and stress on the motor bearings. The continuous 
outer edge of the shutter serves to carry the timing fiducial at the maximum distance 

1 0 from the axis where it is most sensitive and serves a safety function as well in the 
case of an inadvertent touch during assembly and testing. The aperture in the visible 
reference shutter 844 is positioned to match the normal green or red period of the 
video timing sequence. This instrument can either provide a single false color image 
for each footswitch signal or a series of processed images at a submultiple of the 30 

1 5 Hz video frame rate. 

A standard personal computer system can process the acquired data and 
update the false color image at 10 frames per second which is fast enough to 
preserve the impression of smooth motion and slow enough to allow a significant 
increase in the pulsed lamp current. Operation at lower submultiples of 30 Hz (7.5 or 

20 6 Hz) still provides adequate real-time feedback and permits higher pulsed currents 
(and thus brighter UV illumination) without exceeding the nominal 100W average 
power dissipation in the lamp. 

Figures 9a - 9c show details of the optical fiber probe which delivers the UV 
and reference light pulses from the source described above, through a biopsy 

25 channel in the endoscope, to the tissue at the distal tip of the endoscope. The 

delivery fiber 900 must transmit both the UV and the reference light wavelengths, 
couple efficiently to the light source and be sufficiently flexible so that it doesn't 
significantly affect the flexibility of the endoscope tip. 

The fibers can be made with multiple, small-diameter fused silica fibers, but 

30 the preferred system uses a single, UV-transmitting acrylic fiber with a diameter of 
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from 1.5 to 2 mm. One particular acrylic fiber that is suitable is the Raytela Polymer 
Optical Fiber made by Toray Industries, Inc. The single fiber system increases 
coupling efficiency by eliminating the packing fraction losses of multifiber bundles. 
Eliminating the multiplicity of internal cavities also increases the reliability of the 

5 disinfection process between procedures. 

A window 902 at the tip of the probe is held on with a sleeve 904 and 
low-fluorescence epoxy in the gaps 906, 908 and 910 as shown in Figure 9b. A thin, 
bio-compatible, sheath of heat-shrink tubing protects the thin cladding of the optical 
fiber. A band of epoxy at position 914 in the gaps between the fiber 900, the sheath 

10 912 and the sleeve 904 seals the probe for disinfection and holds the sheath in place. 
This type of fiber has a numerical aperture, NA S of 0.5 which means that the light is 
emitted over a 60 degree, full-angle cone. Probes with a plane window illuminate 
only about half of the 120 degree maximum field of view for a typical endoscope. 
Figure 9c shows a negative lens 916 used in place of the plane window 902 

1 5 with an air gap 91 8 between the lens and the end of the optical fiber. The negative 
lens increases the illuminated field of view at the expense of excitation illumination 
intensity. Additional negative lenses would increase the field further. Probe designs 
such as that of Figure 9c are optimized for scanning large areas while the plane 
window design of Figure 9b is optimized for scanning more localized regions of 

20 dysplasia. These windows or lenses can be made of fused silica or UBK-7 to 

optimize UV transmission. Millimeter thicknesses of common glasses such as BK7, 
however, do not absorb a significant fraction of the excitation illumination. The 
lenses or windows can also be made from a UV-transmitting, blue-blocking, 
red-transmitting glass such as Schott UG-1 if the level of blue fluorescence in a 

25 particular type of delivery fiber degrades the fluorescence image. Such additional 
filtration has not been required in probe designs using the Raytela fiber. 

In a preferred embodiment, constructing the above probe from a UV- 
transmissive plastic will reduce the cost, compared to a fused silica construction, to 
the point where the entire probe can be disposed after a single use. 



BNSDOCID: <WO 0042910A1 _IA> 



WO 00/42910 PCT/USOO/01673 

-24- 

Figures 10a and 10b show how the autofluorescence imaging system shown 
in Figure 3 can be modified for use with a standard, color-CCD video endoscope 
1000. In this type of endoscope the image detection system 1002 detects red, green 
and blue light simultaneously with discretely filtered pixels on the CCD detector. 
5 The illumination source 1008 for this type of video system emits continuous, 

broadband, white light which still needs to be turned on and off with a shutter 1010 
for use with the modified autofluorescence imaging system. In this embodiment the 
excitation/ reference light source 1018 produces the two wavelengths simultaneously 
with the optical train 1020, with a high rejection of light at blue and green 

10 wavelengths 'greater than 1000:1) where the autofluorescence peaks. The spectrum 
of the continuous illumination is shown in Figure 10b. 

For autofluorescence detection the complementary shutters 1010 and 1024 
are triggered as before, causing the tissue to be illuminated with both the excitation 
light and reference light simultaneously. The UV-induced autofluorescence 

1 5 (primarily at 460 nm) is then detected by the blue-responsive pixels in the CCD 
camera. The red reference reflectance image is simultaneously detected by the 
red-responsive pixels. Color CCD cameras typically use electronic shuttering so that 
they don't need a dark period for their readout. In this embodiment, the rotating 
shutters in the excitation/ reference light source 1018 are either stopped in an open 

20 position with a detent, or eliminated altogether if the autofluorescence system is to 
be used only with color video endoscopes. The UV illumination thus lasts for the 
full 33 ms of the frame, increasing the integrated visible fluorescence and reference 
signals and eliminating the need for a pulsed current supply. The lamp current 
supply 1022 could still be pulsed occasionally for single images without overheating 

25 the lamp. The analysis would proceed as before with the reference image appearing 
on the red channel of the RGB NTSC signal and the autofluorescence image 
appearing on the blue channel. 

In the fluorescence image endoscope in accordance with the present 
invention, both the UV-excitation light pulse and the visible-reference light pulse 

30 are delivered to the tissue through an optical probe inserted through a biopsy channel 
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of a standard endoscope. The excitation and reference light could alternatively be 
passed through the illumination bundle of an endoscope if that bundle were to be 
modified to transmit UV as well as visible wavelengths. The requirement would 
remain that the excitation light and the reference light, even if generated by different 
5 sources, have the same angular distribution as they exit the distal tip of the 
endoscope. 

Fi<mres 1 la - 1 Id show an embodiment of the autofluorescence imaging 
system which uses a UV-transmissive endoscope, a standard white light source for 
normal imaging, a separate excitation light source and a coupling box. This system 

1 0 is used if a modified endoscope were to be developed before a dedicated light source 
combining the white light, excitation and reference functions in one unit. In this 
intermediate instrument, the adapter box 1 100 would fit between the standard white 
light illuminator 1 102 and the electrical/ optical connection plug 1 104 of the 
UV-transmissive video endoscope. The optical connection plug 1 106 normally fits 

1 5 directly into the visible light source 1 1 02 to collect the illumination light and pass it 
into the illumination bundle of the endoscope. In this embodiment the optical 
connection plug 1 106 would fit instead into the adapter 1 100 and an identical optical 
connection plug 1 108 on the opposite end of the adapter would fit into the visible 
light source 1 1 02 . A set of imaging optics 1110 would transfer the light emitted 

20 from the exit aperture of plug 1 108 to the entrance aperture of plug 1 106. This set of 
imaging optics would also transfer excitation light from a separate light source, 
exiting the optical fiber 1 1 12 to the entrance aperture of plug 1 106. 

The imaging optics set is detailed in Figure 1 lb. The combination of the 
excitation illumination onto a common axis with the visible illumination is 

25 accomplished with a dichroic beamsplitter cube 1 1 1 4. An achromat 1118 collimates 
visible light expanding from a point 1 1 18 on the exit aperture of plug 1 108. A 
second achromat 1 120 refocuses this light onto point 1 122 on the entrance aperture 
of plug 1 1 06. A set of fused silica lenses 1 124 and 1 126 nominally collimate the 
light from point 1 128 on the exit aperture of the excitation delivery fiber 1112. The 

30 position of these lenses is actually adjusted to provide the best imaging of point 
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1 128 onto point 1 122 since the achromat 1 120 will not be corrected for UV 
wavelengths. 

In this embodiment the reference illumination is derived from the normal red 
illumination light from the visible light source. Filter 1 130 is made of red absorbing 

5 glass which strongly attenuates wavelengths UV, blue and green wavelengths. Filter 
1 130 is mounted on a sliding base 1 134, shown in Figure 11c, and is switched into 
the optical path electromechanically when autofluorescence imaging is to be used. 
The shutter in the UV light source is opened at the same time. The tissue will then 
be illuminated by both the UV and the reference light either simultaneously if a 

1 0 color video endoscope is being used or sequentially if a color wheel video 

endoscope is being used. Filter 1 132 is clear glass which transmits all of the normal 
visible wavelengths. Filter 1 132 is switched in electromechanically when normal 
illumination is to be used so that the focal point of lens 1116 remains constant. 
For the endoscope illumination bundle 1 136 to be both UV-transmissive, 

1 5 flexible and long-lasting it must be made of fused silica optical fibers rather than 
regular glass fibers. The primary optical difference between the two materials, other 
than transparency, is that fused silica fibers generally have a lower numerical 
aperture than glass fibers. This means that light is collected and emitted at smaller 
angles from the axis in fused silica fibers. The illumination bundle bifurcates at 

20 point 1138 and exits the optical ports 1 140 and 1 142 at the distal tip of the 

endoscope. The lens elements in the ports 1 140 and 1 142 must also be modified 
(made more negative) to maintain the same illumination angle for existing, glass 
fiber based endoscopes. 

The video imaging detection system 1144 at the distal tip of the endoscope 

25 transmits its signals back down the electrical wires 1 146 within the endoscope to the 
electrical connector 1 147 on the connector plug 1 104. A mating connector on the 
adapter box 1 100 collects these signals which are transferred across the adapter 1 100 
to a connector plug 1 148 identical to plug 1 147 which completes the electrical 
connections into the video processor. Analysis of the autofluorescence and reference 

30 images then proceeds as before. 
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Once the UV-capable endoscope is available, the excitation source can be 
built into the endoscope light source and video processor so that the entire 
autofluorescence imaging capability is included in the endoscope system itself. This 
preferred embodiment is shown schematically in Figure 12. The electrical/ optical 

5 connection plug 1200 is mated directly to the excitation/ reference/ white light 
source and video processor 1202. This system operates exactly as the embodiment 
shown in Figures 1 la - 1 Id, using a dichroic cube beam combiner system 1204 and 
a reference light filter system 1206, but without the necessity of an external adapter. 
The overall reduction in visible blue-green autofluorescence is the primary 

10 indicator c r ; 3sue dysplasia for the imaging systems described to this point. These 
imaging systems characterize the autofluorescence reduction with a single parameter 
for every pixel in the tissue image. The specific causes of this reduction have been 
described by Zonios et al. in "Morphological Model of Human Colon Tissue 
Fluorescence," IEEE Trans. Biomed. Eng., 43(2), 113-122, 1996, incorporated 

15 herein by reference. The primary fluorophore is collagen, a protein in connective 
tissue, which is found within the thin mucosal layer and which is the dominant 
component of the submucosal layer. The autofluorescence in dysplastic tissue is 
reduced when cells in the mucosal layer enlarge and crowd out the collagen and 
when hemoglobin is added in the tissue due to increased vascularization. The 

20 hemoglobin absorbs some of the autofluorescence. The ability to characterize both 
the intrinsic fluorescence of the tissue (in the absence of absorption) and the level of 
hemoglobin in the tissue improves the ability of the imaging system to correctly 
determine the likelihood of dysplasia. 

The imaging systems described above utilizes two of the three available 

25 imaging periods in the 33 ms acquisition period of a standard, color-wheel 
(monochrome CCD) video colonoscope. During one period, the ultraviolet 
excitation light illuminates the tissue and an autofluorescence image, F, is acquired. 
During a second, period visible red light illuminates the tissue and a reference 
image, R, is acquired which determines the intensity distribution of the ultraviolet 

30 illumination on the tissue. The ratio of these two images produces a single 
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parameter, F/R, for every pixel in the image which represents the relative level of 
overall autofluorescence at that point. The algorithm for highlighting portions of the 
image where dysplasia is likely is primarily one of assigning appropriate threshold 
values to the F/R parameter for each pixel. 
5 The improved imaging system described below and shown in Figures 13a and 

13b utilizes the third imaging period to acquire an additional visible reflectance 
image to allow for a more complete spectroscopic analysis. In this system 
predominately blue light is directed onto the tissue with a central wavelength and 
bandwidth which approximates the fluorescence spectrum induced by the UV 

10 excitation light. As before, this blue light exits the same illumination ports and has 
the same angular intensity distribution as the ultraviolet excitation illumination and 
the visible red reference illumination. The resulting blue reflectance image, B, 
indicates regions where chemical species in the tissue absorb light at these blue 
wavelengths and thus areas of tissue where the intrinsic autofluorescence is reduced 

15 by absorption processes. As before, the red reference image, R, is used as the 

measure of the illumination intensity of all three wavelengths at the tissue surface. 
The specific parameter to indicate (primarily hemoglobin) absorption on a pixel-by- 
pixel basis is thus the ratio B/R. The two parameters, F/R and B/R, are available on 
a pixel-by-pixel basis for determining that the imaged area of tissue indicates 

20 dysplasia. Two basic methods can be used. In one, the F/R ratio can be corrected 
by the B/R parameter to more closely indicate the true value of the intrinsic 
fluorescence which produces a single, modified F/R parameter to which a threshold 
is applied as before. A second procedure uses a two-dimensional surface, defined by 
the F/R and B/R parameters, which can indicate the probability of dysplasia. In both 

25 cases the threshold values for determining which are to be highlighted is determined 
by comparing measured values of F/R and B/R during clinical tests with the results 
of pathology reports on biopsy samples taken from those sites. 

The system in Figures 13a and 13b uses a mercury arc lamp source 1300 as 
before. The same optical elements 1302 and 1304 are used to collect and collimate 

30 the light produced which includes both ultraviolet wavelengths and the full range of 



BNSCOCID: <WO 0042910A1 JA> 



WO 00/42910 PCT/US00/01 673 

-29- 

visible wavelengths. The optical path of the ultraviolet illumination remains the 
same. A dichroic mirror 1306 reflects most of the UV light and some visible light to 
a UV-reflective turning mirror 1308. Again, most of the UV light is reflected while 
most of the visible light is absorbed into the substrate of 1308. A UV bandpass filter 

5 1310 removes almost all of the remaining visible light so that only UV light reaches 
the timing wheel 1312. The timing wheel 13 12 insures that the UV light which 
continues on is only passed during one exposure period for the video colonoscope. 
Another dichroic mirror 1314 and a total reflecting mirror (both UV and visible) 
1318 direct the UV beam to the focusing lens 1 3 1 8. An iris 1 320 defines the angular 

10 extent of the UV light entering the delivery fiber 1322. The delivery fiber 1322 
carries all of the illumination wavelengths to the end of the colonoscope to 
illuminate the tissue. 

The difference between the improved autofluorescence imaging system and the 
systems described previously lies in the path that the visible wavelengths take 

1 5 through the system. Both blue and red wavelengths approach the visible timing 
wheel 1324. This wheel has two apertures which allow light to pass during the two 
remaining exposure periods for the video colonoscope. One of the wheel apertures is 
covered by a red filter 1326 which passes wavelengths appropriate for the reference 
image, R. These wavelengths are chosen to avoid both hemoglobin absorption bands 

20 in the tissue and absorption bands in the optical fiber used to deliver the light to the 
tissue. The light to be filtered is well collimated so that multilayer dichroic coatings 
can be used, but simple absorption filters made of colored glass or plastic are 
adequate. The second aperture on timing wheel 1324 is covered by a broadband blue 
filter which approximates the spectrum of the intrinsic fluorescence produced by the 

25 excitation light. The specific bandpass spectrum of this filter can contain 

wavelengths absorbed by hemoglobin and be sufficiently reproducible so that the 
resulting analysis program can be used by other instruments. The second aperture 
matches the third exposure period of the video colonoscope. Photoelectric detectors 
responding to light passing through timing holes 1330 and 1332 on the two wheels 

30 as shown in Figure 13b provide electrical pulses for the phase-locked loops which 
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keep the timing wheels synchronized with the video acquisition system of the video 
colonoscope. 

The remaining differences between the improved, three-color diagnostic system 
and the two-color system include a broadband, reflective mirror 1334 that must 
5 reflects both blue and red visible wavelengths and an achromatic, long-focus lens 
1336 which corrects for the longer focal length of the fused silica collection lens 
1 306 at visible wavelengths. 

While this invention has been particularly shown and described with 
references to preferred embodiments thereof, it will be understood by those skilled 
10 in the art that various changes in form and details may be made therein without 
departing from the scope of the invention encompassed by the appended claims. 
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CLAIMS 



What is claimed is: 

1 . A fluorescence imaging system comprising: 

a light source for producing excitation light that induces visible 
5 fluorescence in tissue and a reference light; 

an optical combiner that combines said excitation light and said 
reference light onto a common optical path, said combined light being 
coup^d into an optical guide that delivers the combined light to the tissue; 
an image sensor that detects a fluorescence image and a reference 
1 0 image of the tissue; and 

a data processor that processes the fluorescence image and said 
reference image to produce a processed output image of the tissue. 

2. The system of Claim 1 wherein the light source is an arc lamp. 

3. The system of Claim 2 wherein the arc lamp current source is a pulsed 
1 5 source. 

4. The system of Claim 1 wherein the optical guide is a removable fiberoptic 
extending through a biopsy channel of an endoscope. 

5. The method of Claim 1 wherein the image sensor is located at a distal end of 
a endoscope. 

20 6. The system of Claim 1 wherein the excitation light and the reference light are 
emitted sequentially such that a monochromatic image sensors detects a 
fluorescent image during a first time period and detects a reflected image 
during a second time period. 
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7. The system of Claim 1 wherein the excitation light and the reference light are 
emitted simultaneously such that respective images are detected by a 
color-sensitive image sensor, a blue channel detecting the fluorescence image 
and a red channel detecting the reference image. 

5 8. The system of Claim 1 wherein the excitation light is in the range of 300 to 420 
nm. 

9. The system of Claim 1 wherein the light source further comprises a reference 
light source having a wavelength in a red or infrared range. 

10. The system of Claim 1 wherein the optical guide comprises an optical fiber with 
10 a distally mounted lens. 

1 1 . The system of Claim 1 wherein the excitation light has an angular orientation 
that is the same as an angular orientation as the reference light. 

12. The system of Claim 1 further comprising a reference illumination of a selected 
wavelength to provide a second reference image. 

15 13. The system of Claim 1 2 further comprising a light source and a first filter wheel 
that filters light from the light source to provide a first reference illumination 
wavelength and a second illumination wavelength. 

1 4. The system of Claim 1 further comprising a filter wheel having a filter that 
filters light from the light source to provide fluorescence illumination. 
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15. A method for imaging tissue fluorescence comprising: 

detecting a fluorescence image of tissue and a reference image of the 
tissue; and 

processing said fluorescence image together with said reference image to 
5 produce an output image of the tissue. 

16. The method of Claim 15 further comprising providing an arc lamp light source. 

1 7 . The method of Claim 1 6 further comprising pulsing the arc lamp current source. 

18. The method of Claim 15 further comprising sequentially the images with a 
monochromatic image sensor. 

10 19. The method of Claim 1 5 further comprising detecting images with a color- 
sensitive image sensor, the sensor having a blue channel detecting an 
autofluorescence image and a red channel detecting the reference image. 

20. The method of Claim 15 further comprising coupling excitation light and a 
reference light to an optical fiber such that a variation in a normalized intensity 

1 5 of the reference light and a noimalized intensity of the excitation light is less 

than 20% at any point in a wavefront along the optical path between a combiner 
that combines the excitation light and the reference light. 

21. A method for imaging tissue fluorescence comprising: 

providing excitation light having a wavelength in a range of 300 nm to 

20 420 nm; 

providing a reference light; 
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combining said excitation light and said reference light onto a common 
optical path such that an intensity of the excitation light varies less than 20% 
relative to a normalized intensity of the reference light at any point along the 
optical path; 

5 detecting a fluorescence image of the tissue due to the said excitation 

light and a reference image of the tissue due to reflected reference light with an 
imaging sensor at a distal end of an endoscopic probe; and 

processing said fluorescence image and said reference image to produce 
an output image of the tissue. 

10 22. The method of Claim 21 further comprising determining a ratio of the 

fluorescence image and the reference image to provide a processed image. 

23. The method of Claim 21 further comprising adjusting the relative intensity or 
angular distribution of the reference light relative to the excitation light. 

24. The method of Claim 21 further comprising detecting first and second reference 
1 5 images having different wavelengths. 

25. The method of Claim 24 further comprising detecting blue and red reference 
images and forming a third reference image from a pixel-by-pixel ratio of the 
blue and red images. 
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AUTOFLUORESCENCE IMAGING SYSTEM FOR ENDOSCOPY 

GOVERNMENT SUPPORT 

This invention was supported in whole or in part by a grant from the 
National Institute of Health, Grant No. R44CA72626, "Imaging Spectrofluorimeter 
5 for Colonic Dysplasia". The Government has certain rights in the invention. 

RELATED APPLICATION 

This is a coiitinuation-in-part application of U.S. Application No. 
09/362,806, filed July 28, 1999 which is a continuation-in-part application of U.S. 
Application No. 09/238,664 filed on January 26, 1999, the entire contents of the 
1 0 above applications being is incorporated herein by reference. 

BACKGROUND OF THE INVENTION 

Advanced stage cancers are difficult to treat effectively, so it is important to 
detect them in their premalignant stages, such as dysplasia or carcinoma in situ. 
Currently, the most widely used method for early detection uses visual inspection 

15 through endoscopes, which relies upon the recognition of the gross architectural 

changes associated with dysplasia. Visual inspection is less effective in detecting the 
superficial lesions of flat dysplasia, such as ulcerative colitis and Barrett's 
esophagus. In these cases, surveillance requires the selection of representative sites 
for biopsy and subsequent histological analysis. Only a very small fraction of a large 

20 surface, such as the colon, can be surveyed in this manner and small areas of 
dysplasia may go undetected. More efficient methods for detecting flat dysplasia 
would provide a significant means of reducing cancer morbidity, mortality, and 
costs. 
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A promising technique for detecting dysplasia during endoscopy involves 
illuminating the tissue with light of an appropriate wavelength and observing the 
resulting fluorescence. Tissue fluorescence occurs at longer wavelengths than the 
excitation illumination and is typically much weaker, so that spectroscopic 
5 techniques are generally required for its detection. Diagnostic methods which use 
fluorescence information can generally be divided into two groups. The first group 
of methods observes fluorescence from medications administered to the patient 
which have accumulated in tumor tissues. The second group of methods observes 
endogenous fluorescence or autofluorescence arising from substances natural to the 

10 tissue itself which change their relative concentrations when the tissue becomes 
dysplastic. Of the two general fluorescence methods, the first method, requiring a 
prior application of a drug, is the more invasive. The application of these drugs takes 
additional time and has the potential of causing adverse side effects. Methods based 
on autofluorescence detection are less invasive and more suited to endoscopy for 

15 screening purposes. 

Normal colon tissue, for example, when illuminated with ultraviolet light at 
370 nm, exhibits a broad, blue fluorescence with a peak at 450 nm, as shown in 
Figure 1. This fluorescence is due to collagen, the primary protein of connective 
tissue, which is found within the thin mucosal layer and which is the dominant 

20 component of the submucosal layer. The fluorescence of dysplastic colon tissue, due 
to changes in its structure and chemistry, is typically l A to 1/3 as intense given the 
same illumination. This reduction in visible blue-green autofluorescence, produced 
by ultraviolet to violet excitation light, has been identified as a primary indicator of 
dysplastic tissue. An increase in the relative fluorescence at 680 nm compared to 

25 600 nm is a secondary indicator of dysplasia. 

Diagnostic instruments which detect autofluorescence can be divided into 
two general groups. The first subdivision includes instruments which utilize 
fiberoptic probes to perform essentially point measurements on the tissue. The 
second subdivision includes instruments which produce detailed, two dimensional 

30 images. Point detection instruments have the advantage of providing more complete 
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spectral information on the tissue, but are too slow for routine screening of large 
tissue areas and may miss small regions of dysplasia. Fluorescence imaging 
endoscopes are more appropriate for screening large tissue areas such as the colon. 
Fluorescence imaging systems designed to sense concentrations of 

5 fluorescent markers that have been applied to the region of interest are optimized for 
the measurement of relatively high fluorescence levels, do not describe the 
additional instrumental features required to measure inherently weak 
autofluorescence. In particular, they do not describe a method for providing 
sufficient out-of-band filtering for the excitation illumination that would allow the 

10 effective measurement of autofluorescence, which typically is reduced in intensity, 
compared to the excitation intensity, by a factor of 1000 or more. 

Fluorescence imaging endoscopes which are specifically designed to 
measure autofluorescence can be further divided into groups based on the excitation 
wavelength chosen and the method for quantifying the degree to which the 

15 autofluorescence is reduced. These design choices have a direct bearing on 

commercial considerations for the instrument since they affect, for example, the 
number of imaging devices required, the opto-mechanical complexity of the 
instrument, and the handling characteristics of the instrument in actual use. 

Existing fluorescence imaging endoscope systems use visible blue light near 

20 440 nm for the excitation wavelength, resulting in fluorescence peaks around 500 
nm. These instruments use Helium-Cadmium lasers at 442 nm as a bright, easily 
controlled source for the excitation light. The high cost of Helium-Cadmium lasers 
makes them impractical as sources for commercial instruments. 

Multiple cameras and mechanically switched optical components and/or 

25 filters require the use of endoscopes based on coherent imaging fiber bundles, so 
that the cameras and filters can be located at the proximal end of the endoscope 
where there is room for them. The coherent fiber imaging bundles introduce 
significant light losses and do not provide as sharp an image as those now available 
with video endoscopes. 
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SUMMARY OF THE INVENTION 

The present invention relates to imaging endoscopes and in particular to an 
endoscope system and method for imaging autofluorescence from epithelial tissue to 
highlight regions of dysplasia. The system for detecting dysplastic tissue uses the 
5 autofluorescence of mucosal tissue such as that found in the colon, the esophagus, 
the oral cavity, the cervix and the lung. The fluorescence imaging apparatus for an 
endoscope of the present invention utilizes a selected range of excitation light 
wavelengths and a fluorescence normalization method. These choices provide for an 
improved endoscope which requires one, non-intensified, imaging detector at the 

10 distal tip of a video endoscope for both white light imaging and fluorescence 

imaging. The imaging detector can be a pixilated integrated circuit device such as a 
CMOS imaging device, charge coupled device (CCD) or other small two 
dimensional imaging sensors that can detect in the visible and infrared ranges. 

The system of the present invention has the ability to switch back and forth 

1 5 between white light and fluorescence visualization methods electronically, requiring 
no moving parts within the endoscope itself. The elimination of cameras and 
imaging optics at the proximal end of the endoscope significantly improves its 
handling characteristics. A computer-based imaging system allows quantitative 
images of the tissue to be displayed, at refresh rates of up to 1 0 Hz or higher, for 

20 example. A preferred embodiment uses easily seen, false-color overlays which 
indicate the likely areas of tissue dysplasia. By "false color" we mean that a color 
value is assigned to a particular level of fluorescence intensity for each pixel. A data 
processing system can be programmed to provide a color system suitable for 
imaging a given type of tissue condition. The system can be used either with color 

25 wheel (e.g., using a monochrome CCD) video endoscopes or with color imaging 
sensor endoscopes. 

In a preferred embodiment, near ultraviolet light is chosen as the excitation 
wavelength, as described in Wang, et al., US Provisional Application No. 
60/072,455, January 26, 1 998. This choice in the range of 300-420 nm reduces or 

30 eliminates the need for additional filters between the tissue and the imaging detector 
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due to the fact that standard, electronic imaging sensors, as .used in video 
endoscopes, are insensitive to the excitation light. Visible red light, to which the 
imaging detector is very sensitive, is chosen to illuminate the tissue for the purpose 
of acquiring a reference image. This reference light is passed through the same 

5 optical guide as the excitation light, and illuminates the tissue with the same 

normalized spatial distribution and angular distribution as the excitation light. By 
correlating the spatial intensity and angular distribution of light used for the 
reflected image and the light for the fluorescence image, a more accurate and 
diagnostically useful imaging system is provided. This system of the present 

10 invention allows the reference image to be used to normalize the fluorescence image 
so that local reductions in fluorescence intensity can be accurately quantified. In 
another preferred embodiment, using color wheel (monochrome CCD) video 
endoscopes, the reference light and excitation light are applied sequentially. In 
another preferred embodiment, using color CCD video endoscopes, the fluorescence 

1 5 excitation light and reference light are applied simultaneously. 

An additional reference image can be taken using a third color channel of the 
video colonoscopy The reference light directed onto the tissue for this image is 
predominately blue in color, with a central wavelength and bandwidth which 
approximates the fluorescence spectrum induced by the UV excitation light. The 

20 ratio B/R of this blue reference image, B, to the red reference image, R, on a pixel- 
by-pixel basis, identifies areas of the imaged tissue where chemical species 
(predominately hemoglobin) absorb some of the intrinsic fluorescence before it can 
exit the tissue and be imaged. The acquisition of the ratio F/R of the fluorescence 
image, F, to the red reference image, R, consequently provides two parameters, F/R 

25 and B/R, that can be used on a pixel-by-pixel basis for determining whether 
abnormal tissue such as dysplasia is present in the imaged region of interest. 
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i. 

BRIEF DESCRIPTION OF THE DRAWINGS 

Figure 1 is an illustration of the fluorescence spectrum of normal and 
dysplastic colon tissue due to excitation with UV light at 370 nm. 

Figures 2a and 2b are diagrams of the fiberoptic delivery probe system in 
5 accordance with the present invention. 

Figure 3 is a schematic diagram of an embodiment of the fluorescence 
imaging endoscope of the present invention which uses a separate fiberoptic light 
guide to deliver the UV excitation light through a biopsy channel of a color-wheel 
(monochrome CCD) video endoscope. 
10 Figure 4 is a flow chart for the production of the output image. 

Figure 5 illustrates a timing diagram for the image acquisition, analysis and 
display process in accordance with the present invention. 

Figures 6a - 6c illustrates the UV output from a mercury arc lamp as a 
function of pulsed current in accordance with the present invention. 
1 5 Figure 7 is a schematic diagram of a computer-controlled, pulsed lamp 

power supply in accordance with the present invention. 

Figures 8a - 8d illustrate the details of op to-mechanical elements of the 
pulsed light source in accordance with the present invention. 

Figures 9a - 9c illustrate the construction of the optical delivery fiber used in 
20 accordance with the present invention. 

Figures 10a - 10b are schematic diagrams^of a preferred embodiment of the 
imaging system which uses a separate fiberoptic light guide to deliver the UV 
excitation light through a biopsy channel of a color CCD video endoscope. 

Figure 1 la - 1 Id are schematic diagrams of a preferred embodiment of the 
25 imaging system which integrates the UV-transmissive illumination guide into the 
endoscope and connects an external UV excitation source to a standard white light 
source with an adapter module. 

Figure 12 is a schematic diagram of a preferred embodiment of the imaging 
system which fully integrates the excitation light source and white light source into 
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an illumination system for an endoscope fitted with UV-transmissive illumination 
guide. 

Figures 13a and 13b illustrate another preferred embodiment of an 
illumination and collection endoscope imaging system. 

5 The foregoing and other objects, features and advantages of the invention 

will be apparent from the following more particular description of preferred 
embodiments of the invention, as illustrated in the accompanying drawings in which 
like reference characters refer to the same parts throughout the different views. The 
drawings are not necessarily to scale, emphasis instead being placed upon 

1 0 illustrating the principles of the invention. 

DETAILED DESCRIPTION OF THE INVENTION 

The present invention relates to systems and methods for imaging 
auto fluorescence from epithelial tissue to highlight regions of dysplasia. The tissue 
autofluorescence imaging system in accordance with the present invention improves 

15 upon the previous state of the art in that, in its simplest form, it can be added on to 
an existing video endoscope system with no modifications to the endoscope itself, 
and with only the addition of a shutter in the optical path of the endoscope's visible 
light source. The handling characteristics of the endoscope are thus not adversely 
affected by the addition of image intensifies and external cameras at the proximal 

20 end as required by fluorescence imaging systems currently on the market. Switching 
between normal visible light imaging, in full color, and fluorescence imaging is 
accomplished by an electronic switch rather than a physical manipulation by the 
clinician, also required by current systems. The resulting fluorescence video image 
is processed by a computer so that the diagnostic image seen by the clinician 

25 consists of a familiar visible light image (in gray scale) with a false color overlay 
indicating those areas in the image where the fluorescence from the tissue is reduced 
in comparison to the fluorescence from normal tissue. This image is much easier to 
interpret than the combined red/green raw fluorescence images provided by current 
systems, particularly for red/green color-blind clinicians. 
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The system of the present invention uses only a single imaging detector at 
the distal end of the endoscope for acquiring normal color images, fluorescence 
images and visible reference images. The use of a camera at the distal end is made 
possible by using fluorescence excitation light at ultraviolet to deep violet 

5 wavelengths to which the CCD camera is insensitive or can be made insensitive 
using a fixed filter. This allows broadband collection of the resulting tissue 
autofluorescence from blue to red wavelengths, resulting in sufficient light for 
effective video signals without the need for additional image intensification. 
Fluorescence imaging in this fashion has been described in-vivo by Wang, et al. as 

1 0 described in U.S. Application No. 09/238,664, entitled "Fluorescence Imaging 

Endoscope" filed on January 26th, 1999, the entire contents of which is incorporated 
herein by reference. 

Previous autofluorescence imaging systems have depended upon imaging 
very weak fluorescence at red wavelengths to provide an image to compare with the 

1 5 fluorescence image taken at blue-green wavelengths. Additional image 

intensification is particularly necessary to provide a usable red fluorescence images. 
The autofluorescence imaging system and method of the present invention avoids 
this expense and difficulty by supplying additional visible red light illumination to 
the tissue for the purpose of obtaining a reference image. To be effective, however, 

20 the UV excitation light and the visible reference light must be delivered to the tissue 
through a common optical guide and exit the same illumination aperture with the 
same angular distribution. This requires a careful design of the excitation and 
reference light source optics. The processing of the reference image includes other 
features, such as histogram analysis, to eliminate artifacts such as visible specular 

25 reflections which do not occur in fluorescence images. 

The combination of the system features in accordance with the present 
invention can be realized in several different ways, depending upon the endoscope 
with which the autofluorescence imaging system is combined. Some of these 
features can also be built into the endoscope itself in stages as the technology is 

30 accepted by clinicians. 
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In a preferred embodiment, the excitation illumination and reference 
illumination are generated by the same arc lamp source and delivered to the tissue 
through the same fiberoptic probe passed through a biopsy channel of the 
endoscope. In other embodiments the excitation light can be generated with a 

5 stand-alone source but delivered to the tissue through UV-transmissive illumination 
bundles built into the endoscopes as replacements to the standard, UV-absorbing 
glass bundles. The reference illumination is derived from the normal white light 
illumination source by switching in a red-pass filter that absorbs light at blue and 
green wavelengths which can interfere with imaging the predominately blue 

1 0 fluorescence. A deep red light source or near infrared (e.g., at 670 nm or above) can 
be used without affecting the normal visible illumination and can be combined with 
a dichroic element for delivery along a common optical path. In further 
embodiments, the excitation light source can be combined with the standard, white 
light illumination source and delivered to the tissue through an endoscope with 

15 UV-transmissive fiberoptic illumination bundles. A rotating wheel light source can 
also be modified to produce four colors, ultraviolet, blue, green and red, to perform 
both the fluorescence imaging and the visual imaging. 

Figures 2a and 2b show the general components of a preferred embodiment 
in which the excitation light and the visible reference light are delivered to the tissue 

20 through a separate fiberoptic probe. The fiberoptic probe 200 is passed through a 
biopsy channel of a standard video endoscope 202 with its tip finally placed at or 
near the distal tip of the endoscope 204. When a footswitch 206 is depressed by the 
clinician, the normal white light illumination from the endoscope's light source and 
video processor 208 is switched off with a shutter. This white light normally 

25 illuminates the tissue through the two fiberoptic illumination ports 210 and 212 on 
the distal tip of the endoscope. Simultaneously, a complementary shutter in the 
excitation and reference illumination source 214 is switched on so that excitation 
and reference light can pass through the fiberoptic probe 200. The excitation and 
reference light exits the tip of the fiberoptic probe 216 and illuminates the tissue 

30 218. The video image detection system 220 transmits the resulting fluorescence 



BNSDOCID: <WO„ 



004291 OA 1 J. > 



WO 00/42910 



PCT/US00/01673 



-10- 

image signal and reference image signal back through the endoscope 202 to the 
video processor 208 where they are converted into different color channels R and B) 
in a standard R,G,B National Television Standards Committee (NTSC) video 
format. These two channels are digitized with a video framegrabber in the computer 
5 system 222. The digitized fluorescence and reference images are processed together 
in real time to quantify image regions where the fluorescence is reduced compared 
to normal tissue. Reduced fluorescence is the primary indicator of dysplasia. Areas 
of the tissue which are likely to be dysplastic are highlighted with false color in a 
processed image of the tissue which is displayed on a computer monitor 224 and 

10 updated at a rate of up to 10 Hz. The preferred embodiment shown in Figures 3a and 
3b is thus an add-on component to an existing endoscope/ video processor system 
which only requires the addition of an internal shutter to the white light source in the 
endoscope systems video processor. For color-wheel (monochrome CCD) video 
endoscopes, the excitation light source 214 is constructed to provide sequential 

15 excitation and reference illumination as described in more detail hereinafter. For 
color-CCD video endoscopes the excitation light source 214 provides simultaneous 
excitation and reference illumination, also described in more detail hereinafter. 

The autofluorescence imaging system demonstrated by Wang, et al. used an 
argon-ion laser as a UV excitation source. Other laser sources can be used including 

20 solid state lasers, such as gallium nitride laser diodes, operating at wavelengths in 
the range of 380 nm to 420 nm, which have smaller size and low power operation. 
The systems in accordance with the present invention uses a mercury arc lamp as a 
source of UV excitation with a spectral band around the 365 nm mercury line. The 
mercury arc source is smaller, and less expensive than the argon-ion laser, requires 

25 relatively little power and is air-cooled. For the autofluorescence imaging systems 
used with color wheel (monochrome CCD) video endoscopes, the current to the arc 
lamp can be pulsed. In the color wheel video systems, the normal light source 
provides red, green and blue light pulses sequentially during a 33 ms video frame 
which are combined with the video processor to provide a color image. In the 

30 autofluorescence imaging mode these systems replace the normal blue light pulse 
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with a UV pulse and the green light pulse with a (nominally red) reference light 
pulse transmitted through the same optical fiber as the UV pulse. By pulsing the arc 
lamp current for the 8 ms period that the blue light is normally on, the UV source 
can provide as much or more excitation fluence to the tissue than it could if the CW 

5 lamp intensity was integrated over the full 33 ms video frame period. 

With both color wheel video systems and color CCD video systems the 
autofluorescence imaging mode is initiated with a footswitch which controls 
complementary shutters on the excitation/ reference light source and the normal 
endoscope white light source. Shutting off the normal endoscope illumination is 

1 0 required in order to image the weak fluorescence from the tissue. Two different 
autofluorescence imaging modes can be used. In one mode, a single frame of the 
false color overlay from the processed autofluorescence image is combined with the 
immediately preceding (or following) color image and frozen on the computer 
screen. In the second mode the processed fluorescence image is updated 

1 5 continuously (at about 7.5 Hz to 10 Hz allowing for the image processing time) for 
as long as the footswitch is depressed. In the continuous operation mode the visible 
image is shown as a gray scale (since it is taken with a monochrome reference 
illumination) with false color overlays showing regions of likely dysplasia. 

Figure 3 shows an overall schematic diagram of a preferred embodiment of 

20 the fluorescence imaging system for use with color wheel (monochrome CCD) video 
endoscopes. For normal mode of operation of the color wheel video endoscope, the 
distal tip of the endoscope 300 is inserted into the hollow organ of the body to 
observe an area of tissue 302 which may contain a region which is dysplastic 304. 
The CCD imaging device and lens subsystem (the video camera) 306 is flanked on 

25 either side by the normal illumination apertures 308 and 3 1 0. 

The normal illumination light is carried by a fiberoptic bundle 312 which 
extends through the length of the endoscope and bifurcates near its distal tip, 
terminating at apertures 308 and 310. A shutter 314 between the illumination source 
and the fiberoptic bundle, controlled by a digital signal 315, allows the white light 

30 illumination to be turned off without turning off the source lamp 3 16. In the type of 
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endoscope shown, the normal color image is obtained by combining three, 
successive images taken with red. green and blue light pulses provided by a rotating 
filter wheel 318. The CCD detector in this type of endoscope is sensitive to all 
wavelengths between 400 nm and 700 run, but is insensitive to UV excitation 
5 wavelengths around 365 nm which are used to excite the autofluorescence. This is 
due both to the design of the silicon sensor array and to the choice of optical 
materials used to physically protect the surface of the array. The CCD detector 
continuously integrates all of the light which falls on its surface so the illumination 
must be shuttered off while the CCD rows are shifted down to the readout 

1 0 electronics or else a streaking effect will be seen on the image. The red, green and 
blue light pulses have a duration of about 6 ms followed by a dark period of 5 ms 
during which the camera pixels are read out, yielding a total video frame period of 
about 33 ms or 29.97 frames per second to meet the NTSC standard. The analog 
readout signal from the CCD camera is carried through a cable 320 to the endoscope 

1 5 video processor 322. 

The three successive monochrome images are digitized and combined into a 
standard color video signal at the end of the video frame. The processor has two 
groups of standard red, green, blue (RGB) plus synchronization outputs. One output 
group of color signals 324 goes to the endoscopes video monitor 326 to display the 

20 normal color image of the tissue 328. Another group of color signals 330 goes to a 
video framegrabber 332 in the fluorescence imaging computer system 334 which 
will acquire and process the autofluorescence and reference images. A standard 
composite color signal output 336 from the video processor goes to a 
synchronization circuit 338, based on a National LM1881 Video Sync Separator. 

25 This synchronization circuit 338 determines when the interlaced even and odd fields 
occur in the video signal and outputs a binary digital signal 340 which is high during 
the odd field and low during the even field. This signal 340 is used throughout the 
fluorescence imaging system to synchronize its functions to the timing set by the 
endoscope's video processor. 



00429 J OA 1 | > 



WO 00/42910 PCT/US00/01673 

-13- 

To engage the autofluorescence imaging mode of operation, the clinician 
depresses footswitch 341 which sends a signal on cable 342 to the computer 334. At 
the appropriate time, synchronized to the next opportunity as determined by the 
synchronization signal 340, a signal is sent out on the shutter trigger line 315 to 

5 shutter 314 on the normal illumination source and the shutter 343 on the excitation/ 
reference light source. These shutters are complementary, so that the signal on line 
315 opens shutter 343 and simultaneously shuts shutter 314. The excitation and 
reference light pulses, generated by the rotating shutter wheels in the optical group 
350, then pass into the fiberoptic probe 344. Probe 344 is inserted into a biopsy 

10 channel opening 345 and slid down the channel until its end window 346 is either at 
or just beyond the distal tip of the endoscope 300. The excitation and reference light 
pulses illuminate the central portion of the endoscope's visual field. The angular 
extent of the illumination depends on optical elements 350, the fiber numerical 
aperture, and the optical characteristics of the fiberoptic probe end window 346. 

1 5 The excitation and reference light pulses must occur during two of the three 

normal illumination pulse periods for the autofluorescence and reference images to 
be properly acquired. These images appear on the next video output frame on two of 
the three video output channels from the endoscope video processor. The appropriate 
timing is accomplished by rotating shutters 352 and 354 in the excitation (UV) and 

20 reference (RED) light paths, respectively, of the optical group 350. The shutters are 
driven by direct current (DC) motors 356 and 358 which rotate at a speed which can 
be controlled by varying their supply voltage. A fiducial hole near the rim of the 
shutters, combined with an optical source and detector, generates a reference pulse 
for each which marks its phase as it rotates. A phase-locked loop (PLL) 362 and 360 

25 for each motor, 358 and 356, respectively, adjusts the motors voltage so that the 
reference pulse for each matches the rising edge of the synchronization pulse 340 
marking the beginning of the odd video field. 

By positioning the hole in the shutters appropriately the excitation light pulse 
and the reference light pulse can be timed to the exposure periods of the camera. The 

30 excitation pulse is timed to match the normal blue exposure since this exposure 
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period is somewhat longer (8. 1 ms) than the others. The reference light pulse is 
timed to match the normal green light exposure (5 ms) since it is the next longest of 
the normal exposure periods. The normal red exposure period, which immediately 
follows the normal blue exposure period, is not currently used, but can be employed 
5 to obtain additional autofluorescence or reference images or an additional visible 
reflectance image for other spectroscopic analyses. During the excitation exposure 
the current to the mercury lamp can be boosted to a higher level to increase the 
excitation light output. The lamp power supply utilizes a DC current section 366 to 
maintain the idle current and start the lamp. 

1 0 A computer-controlled, pulsed current section 368, connected in parallel with 

the DC section 366, can rapidly switch in multiple, parallel-coupled, 
constant-current sources to vary the output power of the lamp as required by the 
imaging system. The current pulses are synchronized to the video system using the 
same synchronization pulse 340 that serves to lock the rotating shutters. The 

15 computer digital input/output (I/O) section 370 outputs a digital pulse 372 which is 
combined with the timing pulse 340 to boost the lamp current during the excitation 
exposure. The number of constant current sections which are triggered in parallel 
can be varied by a set of digital control lines 374 as required. If the tissue is 
sufficiently close to the excitation/ reference delivery probe window 346 then no 

20 boost may be required. If the peak value of the autofluorescence image drops to a 
minimum acceptable level, as determined by the computer image analysis program 
376 as monitored by the overall control program 378, then additional current boost 
sections are enabled as required for the next exposure. 

Once the autofluorescence image and the reference image have been 

25 acquired by the digital framegrabber in the computer then the analysis can begin. A 
reflectance (non-fluorescing) image taken with an endoscope camera system 
measures the brightness of the tissue surface in its field of view. To the extent that 
the tissue surface is a Lambertian (non-specular) reflector, the reflectance image 
signal (as digitized by the video framegrabber for each discrete pixel in the video 

30 image) is proportional to distance of the tissue from a single illumination source (or 
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a weighted distance from multiple sources), and to the integrated energy of the 
excitation illumination during that video frame. The end window 346 of the 
excitation/ reference delivery probe is not in the direct line-of-sight from the camera 
lens to the tissue so there will be visible shadows. A reflectance image can thus be 

5 used to measure the excitation illumination at the tissue surface visible to the 

camera, including the presence of shadows in the autofluorescence image. Note that 
this is only true if the excitation illumination and the visible illumination emanate 
from the same aperture with the same transverse intensity profile and angular 
divergence as provided by the design of the source as described herein above. A 

1 0 visible reflectance image taken with light from the illumination bundles of a 

standard endoscope, for instance, is not acceptable for determining the excitation 
illumination from a separate optical fiber passed through a biopsy channel of that 
endoscope. Note also, however, that the same aperture/ same divergence condition 
can be satisfied by passing both the excitation and the reference light pulses through 

1 5 the illumination bundle of the endoscope. 

The sequence of steps for obtaining a false color indication of dysplasia 
probability using the visible reference image along with the autofluorescence image 
proceeds as follows. The two images are first corrected for the gamma factor applied 
to the video signal by the video processor which is generally connected to a video 

20 monitor rather than a framegrabber. This insures that the digitized images acquired 
by the framegrabber in the computer are linear functions of the illumination fluence 
(time-integrated intensity). The two images are then normalized to their peaks, 
which is generally a region of non-dysplastic tissue somewhere in the visual field. 
There are a few pixels in the reference image which are saturated due to specular 

25 reflections of the reference illumination. These are effectively eliminated by 

producing a histogram of the reference image and normalizing the image to a peak 
value. This generally includes about 99% of the pixels. 

All normalized reference image pixels above a value of 1 (the specular 
reflections) are then reset to a value of L There are no specular reflections in the 

30 autofluorescence image so such a histogram-based normalization is not necessary. 
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On a pixel-by-pixel basis the autofluorescence image value is then divided by the 
corrected reference image value to produce a ratio image. This division is performed 
only when the autofluorescence and reference image pixel values are above a 
minimum threshold condition to insure that the analysis is not attempted with too 
5 little illumination to provide a reliable measurement. 

If a ratio image pixel value falls below a predetermined value (typically 
one-half to one-third) then that pixel represents a region of reduced fluorescence on 
the tissue surface which is indicative of dysplasia. The corresponding pixel in the 
processed output image can then be set to a false color state to indicate the relative 

10 probability of dysplasia. If the ratio image pixel value is below 1/3 the red value of 
the corresponding processed output image pixel it is set to the value of the reference 
image and the green and blue values of that pixel are set to zero (it is a shaded red, 
indicating a high probability of dysplasia). If the ratio image pixel value is !4 to 1/3, 
then the green value of the processed output image pixel it is set to the reference 

1 5 image value and the red and blue values are set to zero (it is a shaded green, 
indicating a moderate probability of dysplasia). If the ratio image pixel value is 
above } A then the red, green and blue values of the processed output image pixel are 
all set to the reference image value (it is a shaded gray, indicating the probability 
that the tissue is normal). This processed output image 386 is displayed on an LCD 

20 monitor 384 attached to the system computer 334. 

Figure 4 illustrates a process sequence 400 after a patient has been prepared 
the endoscope inserted into the body cavity or human and the distal end thereof has 
been positioned for imaging of a region of interest. In this particular example, a 
visible reference image is obtained 402. This reference data is corrected 404, a 

25 histogram is generated 406, the data is normalized 408, selected pixels are reset 410 
and a threshold value is applied 412. After a fluorescence image is obtained 420, the 
image is corrected 422, normalized 424, a threshold. applied 426, and a ratio image is 
generated 430. The resulting output image or representation is then compared 432 
to a reference, and a given region is determined to be normal 440 or dysplastic 450. 
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Figure 5 shows a timing diagram for one cycle of the imaging process. The 
maximum video output rate is 29.97 Hz as set by the NTSC standard. The diagram 
indicates a system which requires one frame time for acquisition, between two and 
three frame times for analysis, and a fraction of a frame time for transferring the 

5 result to the output image buffer. The resulting update rate for the analysis image is 
7.5 frames per second. With a single, fast processor, the analysis time can be 
reduced and the update rate correspondingly increased to 10 or 15 frames per 
second. The image analysis can also be performed at output rates up to 30 frames 
per second by, for example, using two processors operating in parallel with only a 

10 few frames of delay between acquisition and display. Increased update rates, 

however, require a reduced upper limit on the pulsed current to the lamp in order to 
maintain an average lamp dissipation of no more than 100 W. Figure 5 also shows 
how the mercury lamp current is boosted only during the blue exposure periods 
which result in autofluorescence images. At other times the lamp idles at a reduced 

15 power. 

Figures 6a and 6b show that the UV output power from a 100 W Hg arc 
lamp, pulsed for 8 ms above a 70% idle current, is essentially a linear function of its 
input power to at least a factor of 5 over its nominal rated power. Boosting the lamp 
current during the UV exposure period increases the lamp output power which, in 

20 turn, allows a larger area of tissue to be scanned for dysplasia. It also provides a 
means for adjusting the output of the lamp for an optimum video exposure on a 
pulse-to-pulse basis. Since the lamp discharge maintains a nearly constant voltage 
drop across the arc regardless of current, the lamp output power is essentially 
proportional to current. About 70% power to the lamp must always be maintained, 

25 however, to keep the mercury in the vapor phase. Figure 6c shows that pulsing the 
current to a factor of 5 over the rated CW current can be repeated continuously at a 
rate of 7. 5 Hz. 

Figure 7 shows a block diagram of the lamp power supply as it connects to 
the mercury arc lamp 700. The DC idle current circuit 702 and high voltage (HV) 
30 starting pulse circuit 704 are handled by a single commercial power supply designed 
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for CW 1 00 W mercury arc lamps. The constant current, triggered pulse circuit 706 
is designed to match the specific requirements of the fluorescence imaging 
endoscope. Four of these circuits are connected in parallel so that the output of the 
arc lamp can be set digitally to one of 5 different power levels (including idle). Each 
5 circuit is composed of a power MOSFET switch which adjusts its resistance to keep 
the passed current at a fixed level, typically equivalent to the normal DC current of 4 
amps. These circuits can be individually triggered by a computer whenever their 
current boost is required to properly illuminate the tissue. Each circuit draws its 
current from a storage capacitor 708 charged by a power supply 710 through a 

10 current limiter 7 1 2. This limited current design minimizes the possibility of fault 
conditions which could overload the power handling capacity of the arc lamp. 

Figures 8a, 8b, 8c and 8d show details of the excitation/ reference 
illumination source optics. A single mercury arc lamp 800 in Figure 8a is used as the 
source of both wavelengths because both the UV/violet excitation light and the 

15 red/near infrared reference light need to have the same apparent source volume 802 
at the distal tip of the endoscope. Small 100 W, mercury arc lamps have arc 
dimensions of 0.5 to 1.0 mm which are small enough to couple efficiently into the 
optical fibers used to deliver the light to the tip of the endoscope. Separate lamps 
can be used for the excitation and reference beams, but the tolerances for the source 

20 optics and the alignment of the source arcs are then more critical. In the preferred, 
single lamp, source design shown in Figure 8a the light collection optic 804 is 
shown schematically as a single, fused silica, UV-transmitting lens. In practice 
either a multiple element lens design or a mirror-based Schwarzschild objective is 
used to reduce optical aberrations on the collected beam. Such collection optics 

25 could also collimate light from the focal volume of a commercial mercury arc lamp 
with a fixed, pre-aligned, elliptical reflector as an alternative source. The collection 
optics 804 collimate the light from the lamp so that it can be effectively filtered into 
UV and visible components by means of a dichroic mirror 806 which reflects UV 
and/or deep violet wavelengths and transmits visible wavelengths. 
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Separation into two paths is required so that two rotating shutters, 808 and 
810, can produce UV excitation and visible reference pulses at different times during 
the video frame as described above. A UV -reflective surface coating on mirror 812 
immediately after the dichroic mirror reflects nearly 100% of the desired UV light in 

5 that path and dumps much of the undesired visible light reflected from the dichroic 
into its substrate. Additional UV filters represented by element 814 may include 
absorptive filters such as Schott UG-1 glass as well as multilayer dielectric bandpass 
filters centered on the 365 nm line of mercury. The UV path rejects visible light to a 
high degree since the efficiency of the 460 nm tissue fluorescence is only about 

10 0.1%. Leakage of visible source light during the UV exposure period reduces the 
contrast of the autofluorescence image. Some correction for such leakage is possible 
during the digital image processing but corrections always add a small amount of 
noise to the result. 

The first element in the reference path is a weak lens 816 to correct for the 

15 lower refractive index of the fused silica collimating lens 804 at visible wavelengths 
as compared to the UV. Note that lens 816 would not be necessary if a 
Schwarzschild objective is used at the position of lens 804 since such a design uses 
only mirrors and is thus totally achromatic. An attenuator can optionally be moved 
into the reference path at position 817 to prevent saturation of the reference image at 

20 close inspection distances. This attenuator must be uniform across the area that the 
reference beam passes through in order to maintain the uniform angular intensity 
distribution required of the reference illumination. This attenuation can be 
accomplished with variable, crossed polarizers, differentially-sliding, linear 
attenuation wedges or electromechanically-switched, fixed-value attenuators. The 

25 visible filter 81 8 in the reference beam path is less critical than the UV filter when 
sequential excitation/ reference beams are used such as in the system shown. The 
reference beam wavelength is chosen to avoid hemoglobin absorption bands since a 
significant absorption introduces an error into the analysis which assumes that the 
reference image is equivalent to a measurement of the excitation illumination 

30 intensity. The rotating shutters 808 and 8 10 follow the filters. 
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Continuing down the visible path after shutter 808 is turning mirror 820 with 
a broadband visible reflective coating. A second dichroic mirror 822, identical to 
dichroic mirror 806, recombines the UV excitation beam and the visible reference 
beam onto a common path. One additional turning mirror 824 which reflects both 
5 UV and visible light directs the two beams towards the focusing optics 826 which 
couples them into the delivery fiber 828. The turning mirror 824 makes the number 
of reflections in both the UV and visible paths of the system equal. With equal 
numbers of reflections, any change in the position of the mercury arc 802 relative to 
the position of the collection optics 804 results in the same angular deviation for 

10 both the excitation and reference beams. Equal deviation angles preserves the 

overlap of the excitation and reference beams on the tissue. The system as shown in 
Figures 8a - 8c, in which the combined beams exit the optical train in the same 
direction as the incoming beam, also makes the direction of the output beams 
invariant under translations and small rotations of the optical train as a whole. 

15 The aperture stop 830 in Figure 8a insures that the UV excitation and visible 

reference beams have the same angular convergence on entering the delivery fiber 
828. The transverse dimensions of the two beams at the position of the focusing 
optic 826 will invariably be slightly different due to small errors in the positioning 
of the optics in the two paths and slight differences in the effective emitting volume 

20 of the arc at the two wavelengths. The aperture stop 830 is set so that both beams are 
slightly clipped at their outside edge, insuring that the maximum angular input to the 
optical fiber is the same for both. Figure 8b shows that, to a great degree, the input 
angle to an optical fiber, relative to the fiber axis, is preserved upon each reflection 
within the fiber. Illumination of a fiber with a collimated beam from a single 

25 direction generally results in a cone of emitted light from the opposite end of the 
fiber which has the same angle relative to the axis. The light is spatially averaged 
over the exit aperture of the fiber but the angles only slowly spread due to bends in 
the fiber as it passes down the length of the endoscope. The embodiment shown 
insures that the normalized angular intensity distribution of the excitation 

30 illumination and the reference illumination are closely matched as required by the 
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autofluorescence normalization method. If, for example, the normalized reference 
illumination locally exceeds the normalized excitation illumination in a region 831 
as shown in Figure 8c, then the analysis falsely indicates reduced auto fluorescence 
in this region. If the normalized reference illumination is greater by a factor of two 

5 over the normalized excitation then the analysis provides a false positive indication 
of dysplasia, where the threshold condition is set to 50%. Similarly, if the 
normalized reference illumination is a factor of two below the normalized excitation 
illumination in some region, then the analysis indicates normal tissue even if the 
autofluorescence was actually reduced by the same factor of two in that region. 

10 Such large errors are unlikely in the center of the illumination field but can occur at 
the edges of the field where the illumination drops to the noise level. The threshold 
conditions placed on both the reference and autofluorescence images insure that the 
analysis is not attempted where it is too easily influenced by noise or edge effects. 
In general, it is described to maintain any variation in the intensity distribution of the 

15 reference light as seen at 860 (normalized) at less than 20% relative to the intensity 
distribution of the excitation light at any point along the optical path between the 
combiner and the tissue surface. It is most important to achieve minimal variation in 
intensity at the tissue surface. Thus light exiting the fiber 862 is within the cone 
defined by the angle 0 and variations in intensity at along the wavefront 864 should 

20 be less than 20% to minimize the risk of false image. 

Figure 8d shows a more detailed view of the rotating shutter design in the 
excitation/ reference source. Each blade rotates once in 33.3 ms, the period of one 
video frame. The angle subtended by the aperture 832 on the excitation shutter blade 
810 corresponds to the 8.1 ms period for the normal blue exposure. The timing of 

25 the UV exposure relative to the video frame is set by the phase-locked loop 

matching the rising edge of the optical pulse through the excitation blade fiducial 
834 to the rising edge of the odd field mark on the synchronization signal 340 as 
shown in Figure 3. The apparent position of the excitation beam in the optical train 
is marked by the dotted circle 836. For the relative dimensions of the beam diameter 

30 to shutter diameter shown the total rise time of the light pulse is 1.7 ms which is 
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acceptable compared to the total length of the pulse. The blade 810 is thin, light in 
weight and opaque, made from a material such as stainless steel or glass-fiber 
reinforced epoxy. 

Minimizing the moment of inertia simplifies locking the shutter's rotation 
5 rate with the PLL. Being opaque is important to prevent light leakage. The cutouts 
838 around the central hub 840 of the wheels leave thin blade flexures 842 which 
allow the wheel to flex slightly as it rotates to stay perpendicular to the rotation axis 
of the motor, minimizing vibration and stress on the motor bearings. The continuous 
outer edge of the shutter serves to carry the timing fiducial at the maximum distance 

10 from the axis where it is most sensitive and serves a safety function as well in the 
case of an inadvertent touch during assembly and testing. The aperture in the visible 
reference shutter 844 is positioned to match the normal green or red period of the 
video timing sequence. This instrument can either provide a single false color image 
for each footswitch signal or a series of processed images at a submultiple of the 30 

1 5 Hz video frame rate. 

A standard personal computer system can process the acquired data and 
update the false color image at 10 frames per second which is fast enough to 
preserve the impression of smooth motion and slow enough to allow a significant 
increase in the pulsed lamp current. Operation at lower submultiples of 30 Hz (7.5 or 

20 6 Hz) still provides adequate real-time feedback and permits higher pulsed currents 
(and thus brighter UV illumination) without exceeding the nominal 100W average 
power dissipation in the lamp. 

Figures 9a - 9c show details of the optical fiber probe which delivers the UV 
and reference light pulses from the source described above, through a biopsy 

25 channel in the endoscope, to the tissue at the distal tip of the endoscope. The 

delivery fiber 900 must transmit both the UV and the reference light wavelengths, 
couple efficiently to the light source and be sufficiently flexible so that it doesn't 
significantly affect the flexibility of the endoscope tip. 

The fibers can be made with multiple, small-diameter fused silica fibers, but 

30 the preferred system uses a single, UV-transmitting acrylic fiber with a diameter of 
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from L5 to 2 mm. One particular acrylic fiber that is suitable is the Raytela Polymer 
Optical Fiber made by Toray Industries, Inc. The single fiber system increases 
coupling efficiency by eliminating the packing fraction losses of multifiber bundles. 
Eliminating the multiplicity of internal cavities also increases the reliability of the 
5 disinfection process between procedures. 

A window 902 at the tip of the probe is held on with a sleeve 904 and 
low-fluorescence epoxy in the gaps 906, 90.8 and 910 as shown in Figure 9b. A thin, 
bio-compatible, sheath of heat-shrink tubing protects the thin cladding of the optical 
fiber. A band of epoxy at position 914 in the gaps between the fiber 900, the sheath 

10 912 and the sleeve 904 seals the probe for disinfection and holds the sheath in place. 
This type of fiber has a numerical aperture, NA, of 0.5 which means that the light is 
emitted over a 60 degree, full-angle cone. Probes with a plane window illuminate 
only about half of the 120 degree maximum field of view for a typical endoscope. 
Figure 9c shows a negative lens 916 used in place of the plane window 902 

1 5 with an air gap 918 between the lens and the end of the optical fiber. The negative 
lens increases the illuminated field of view at the expense of excitation illumination 
intensity. Additional negative lenses would increase the field further. Probe designs 
such as that of Figure 9c are optimized for scanning large areas while the plane 
window design of Figure 9b is optimized for scanning more localized regions of 

20 dysplasia. These windows or lenses can be made of fused silica or UBK-7 to 

optimize UV transmission. Millimeter thicknesses of common glasses such as BK7, 
however, do not absorb a significant fraction of the excitation illumination. The 
lenses or windows can also be made from a UV-transmitting, blue-blocking, 
red-transmitting glass such as Schott UG-1 if the level of blue fluorescence in a 

25 particular type of delivery fiber degrades the fluorescence image. Such additional 
filtration has not been required in probe designs using the Raytela fiber. 

In a preferred embodiment, constructing the above probe from a UV- 
transmissive plastic will reduce the cost, compared to a fused silica construction, to 
the point where the entire probe can be disposed after a single use. 
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Figures 10a and 10b show how the autofluorescence imaging system shown 
in Figure 3 can be modified for use with a standard, color-CCD video endoscope 
1000. In this type of endoscope the image detection system 1002 detects red, green 
and blue light simultaneously with discretely filtered pixels on the CCD detector. 
5 The illumination source 1008 for this type of video system emits continuous, 

broadband, white light which still needs to be turned on and off with a shutter 1010 
for use with the modified autofluorescence imaging system. In this embodiment the 
excitation/ reference light source 1018 produces the two wavelengths simultaneously 
with the optical train 1020, with a high rejection of light at blue and green 

10 wavelengths (greater than 1000:1) where the autofluorescence peaks. The spectrum 
of the continuous illumination is shown in Figure 10b. 

For autofluorescence detection the complementary shutters 1010 and 1024 
are triggered as before, causing the tissue to be illuminated with both the excitation 
light and reference light simultaneously. The UV-induced autofluorescence 

15 (primarily at 460 nm) is then detected by the blue-responsive pixels in the CCD 
camera. The red reference reflectance image is simultaneously detected by the 
red-responsive pixels. Color CCD cameras typically use electronic shuttering so that 
they don't need a dark period for their readout. In this embodiment, the rotating 
shutters in the excitation/ reference light source 1018 are either stopped in an open 

20 position with a detent, or eliminated altogether if the autofluorescence system is to 
be used only with color video endoscopes. The UV illumination thus lasts for the 
full 33 ms of the frame, increasing the integrated visible fluorescence and reference 
signals and eliminating the need for a pulsed current supply. The lamp current 
supply 1022 could still be pulsed occasionally for single images without overheating 

25 the lamp. The analysis would proceed as before with the reference image appearing 
on the red channel of the RGB NTSC signal and the autofluorescence image 
appearing on the blue channel. 

In the fluorescence image endoscope in accordance with the present 
invention, both the UV-excitation light pulse and the visible-reference light pulse 

30 are delivered to the tissue through an optical probe inserted through a biopsy channel 
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of a standard endoscope. The excitation and reference light could alternatively be 
passed through the illumination bundle of an endoscope if that bundle were to be 
modified to transmit UV as well as visible wavelengths. The requirement would 
remain that the excitation light and the reference light, even if generated by different 
5 sources, have the same angular distribution as they exit the distal tip of the 
endoscope. 

Figures 1 la - 1 Id show an embodiment of the auto fluorescence imaging 
system which uses a UV-transmissive endoscope, a standard white light source for 
normal imaging, a separate excitation light source and a coupling box. This system 

10 is used if a modified endoscope were to be developed before a dedicated light source 
combining the white light, excitation and reference functions in one unit. In this 
intermediate instrument, the adapter box 1 100 would fit between the standard white 
light illuminator 1 102 and the electrical/ optical connection plug 1 104 of the 
UV-transmissive video endoscope. The optical connection plug 1 106 normally fits 

15 directly into the visible light source 1 102 to collect the illumination light and pass it 
into the illumination bundle of the endoscope. In this embodiment the optical 
connection plug 1 106 would fit instead into the adapter 1 100 and an identical optical 
connection plug 1 108 on the opposite end of the adapter would fit into the visible 
light source 1 102. A set of imaging optics 1110 would transfer the light emitted 

20 from the exit aperture of plug 1 108 to the entrance aperture of plug 1 106. This set of 
imaging optics would also transfer excitation light from a separate light source, 
exiting the optical fiber 1 1 12 to the entrance aperture of plug 1 106. 

The imaging optics set is detailed in Figure 1 lb. The combination of the 
excitation illumination onto a common axis with the visible illumination is 

25 accomplished with a dichroic beamsplitter cube 1 1 1 4. An achromat 1118 collimates 
visible light expanding from a point 1 1 18 on the exit aperture of plug 1 108. A 
second achromat 1 120 refocuses this light onto point 1 122 on the entrance aperture 
of plug 1 106. A set of fused silica lenses 1 124 and 1 126 nominally collimate the 
light from point 1 128 on the exit aperture of the excitation delivery fiber 1112. The 

30 position of these lenses is actually adjusted to provide the best imaging of point 
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1 128 onto point 1 122 since the achromat 1 120 will not be corrected for UV 
wavelengths. 

In this embodiment the reference illumination is derived from the normal red 
illumination light from the visible light source. Filter 1 130 is made of red absorbing 
5 glass which strongly attenuates wavelengths UV, blue and green wavelengths. Filter 
1 130 is mounted on a sliding base 1 134, shown in Figure 11c, and is switched into 
the optical path electromechanically when auto fluorescence imaging is to be used. 
The shutter in the UV light source is opened at the same time. The tissue will then 
be illuminated by both the UV and the reference light either simultaneously if a 

10 color video endoscope is being used or sequentially if a color wheel video 

endoscope is being used. Filter 1 132 is clear glass which transmits all of the normal 
visible wavelengths. Filter 1132 is switched in electromechanically when normal 
illumination is to be used so that the focal point of lens 1116 remains constant. 
For the endoscope illumination bundle 1 136 to be both UV-transmissive, 

1 5 flexible and long-lasting it must be made of fused silica optical fibers rather than 
regular glass fibers. The primary optical difference between the two materials, other 
than transparency, is that fused silica fibers generally have a lower numerical 
aperture than glass fibers. This means that light is collected and emitted at smaller 
angles from the axis in fused silica fibers. The illumination bundle bifurcates at 

20 point 1 138 and exits the optical ports 1 140 and 1 142 at the distal tip of the 

endoscope. The lens elements in the ports 1 140 and 1 142 must also be modified 
(made more negative) to maintain the same illumination angle for existing, glass 
fiber based endoscopes. 

The video imaging detection system 1 144 at the distal tip of the endoscope 

25 transmits its signals back down the electrical wires 1 146 within the endoscope to the 
electrical connector 1147 on the connector plug 1104. A mating connector on the 
adapter box 1 100 collects these signals which are transferred across the adapter 1 100 
to a connector plug 1 148 identical to plug 1 147 which completes the electrical . 
connections into the video processor. Analysis of the autofluorescence and reference 

30 images then proceeds as before. 
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Once the UV-capable endoscope is available, the excitation source can be 
built into the endoscope light source and video processor so that the entire 
autofluorescence imaging capability is included in the endoscope system itself. This 
preferred embodiment is shown schematically in Figure 12. The electrical/ optical 

5 connection plug 1200 is mated directly to the excitation/ reference/ white light 
source and video processor 1202. This system operates exactly as the embodiment 
shown in Figures 1 la - 1 Id, using a dichroic cube beam combiner system 1204 and 
a reference light filter system 1206, but without the necessity of an external adapter. 
The overall reduction in visible blue-green autofluorescence is the primary 

10 indicator of tissue dysplasia for the imaging systems described to this point. These 
imaging systems characterize the autofluorescence reduction with a single parameter 
for every pixel in the tissue image. The specific causes of this reduction have been 
described by Zonios et al. in "Morphological Model of Human Colon Tissue 
Fluorescence" IEEE Trans. Biomed. Eng., 43(2), 1 13-122, 1996, incorporated 

15 herein by reference. The primary fluorophore is collagen, a protein in connective 
tissue, which is found within the thin mucosal layer and which is the dominant 
component of the submucosal layer. The autofluorescence in dysplastic tissue is 
reduced when cells in the mucosal layer enlarge and crowd out the collagen and 
when hemoglobin is added in the tissue due to increased vascularization. The 

20 hemoglobin absorbs some of the autofluorescence. The ability to characterize both 
the intrinsic fluorescence of the tissue (in the absence of absorption) and the level of 
hemoglobin in the tissue improves the ability of the imaging system to correctly 
determine the likelihood of dysplasia. 

The imaging systems described above utilizes two of the three available 

25 imaging periods in the 33 ms acquisition period of a standard, color-wheel 
(monochrome CCD) video colonoscope. During one period, the ultraviolet 
excitation light illuminates the tissue and an autofluorescence image, F, is acquired. 
During a second, period visible red light illuminates the tissue and a reference 
image, R, is acquired which determines the intensity distribution of the ultraviolet 

30 illumination on the tissue. The ratio of these two images produces a single 
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parameter, F/R, for every pixel in the image which represents the relative level of 
overall autofluorescence at that point. The algorithm for highlighting portions of the 
image where dysplasia is likely is primarily one of assigning appropriate threshold 
values to the F/R parameter for each pixel. 
5 The improved imaging system described below and shown in Figures 13a and 

13b utilizes the third imaging period to acquire an additional visible reflectance 
image to allow for a more complete spectroscopic analysis. In this system 
predominately blue light is directed onto the tissue with a central wavelength and 
bandwidth which approximates the fluorescence spectrum induced by the UV 

10 excitation light. As before, this blue light exits the same illumination ports and has 
the same angular intensity distribution as the ultraviolet excitation illumination and 
the visible red reference illumination. The resulting blue reflectance image, B, 
indicates regions where chemical species in the tissue absorb light at these blue 
wavelengths and thus areas of tissue where the intrinsic autofluorescence is reduced 

15 by absorption processes. As before, the red reference image, R, is used as the 

measure of the illumination intensity of all three wavelengths at the tissue surface. 
The specific parameter to indicate (primarily hemoglobin) absorption on a pixel-by- 
pixel basis is thus the ratio B/R. The two parameters, F/R and B/R, are available on 
a pixel-by-pixel basis for determining that the imaged area of tissue indicates 

20 dysplasia. Two basic methods can be used. In one, the F/R ratio can be corrected 
by the B/R parameter to more closely indicate the true value of the intrinsic 
fluorescence which produces a single, modified F/R parameter to which a threshold 
is applied as before. A second procedure uses a two-dimensional surface, defined by 
the F/R and B/R parameters, which can indicate the probability of dysplasia. In both 

25 cases the threshold values for determining which are to be highlighted is determined 
by comparing measured values of F/R and B/R during clinical tests with the results 
of pathology reports on biopsy samples taken from those sites. 

The system in Figures 13a and 13b uses a mercury arc lamp source 1300 as 
before. The same optical elements 1302 and 1304 are used to collect and collimate 

30 the light produced which includes both ultraviolet wavelengths and the full range of 
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visible wavelengths. The optical path of the ultraviolet illumination remains the 
same. A dichroic mirror 1306 reflects most of the UV light and some visible light to 
a UV-reflective turning mirror 1308. Again, most of the UV light is reflected while 
most of the visible light is absorbed into the substrate of 1308. A UV bandpass filter 

5 1310 removes almost all of the remaining visible light so that only UV light reaches 
the timing wheel 1312. The timing wheel 1312 insures that the UV light which 
continues on is only passed during one exposure period for the video colonoscope. 
Another dichroic mirror 1314 and a total reflecting mirror (both UV and visible) 
1318 direct the UV beam to the focusing lens 1318. An iris 1320 defines the angular 

10 extent of the UV light entering the delivery fiber 1322. The delivery fiber 1322 
carries all of the illumination wavelengths to the end of the colonoscope to 
illuminate the tissue. 

The difference between the improved autofluorescence imaging system and the 
systems described previously lies in the path that the visible wavelengths take 

15 through the system. Both blue and red wavelengths approach the visible timing 
wheel 1 324. This wheel has two apertures which allow light to pass during the two 
remaining exposure periods for the video colonoscope. One of the wheel apertures is 
covered by a red filter 1326 which passes wavelengths appropriate for the reference 
image, R. These wavelengths are chosen to avoid both hemoglobin absorption bands 

20 in the tissue and absorption bands in the optical fiber used to deliver the light to the 
tissue. The light to be filtered is well collimated so that multilayer dichroic coatings 
can be used, but simple absorption filters made of colored glass or plastic are 
adequate. The second aperture on timing wheel 1324 is covered by a broadband blue 
filter which approximates the spectrum of the intrinsic fluorescence produced by the 

25 excitation light. The specific bandpass spectrum of this filter can contain 

wavelengths absorbed by hemoglobin and be sufficiently reproducible so that the 
resulting analysis program can be used by other instruments. The second aperture 
matches the third exposure period of the video colonoscope. Photoelectric detectors 
responding to light passing through timing holes 1330 and 1332 on the two wheels 

30 as shown in Figure 13b provide electrical pulses for the phase-locked loops which 
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keep the timing wheels synchronized with the video acquisition system of the video 
colonoscope. 

The remaining differences between the improved, three-color diagnostic system 
and the two-color system include a broadband, reflective mirror 1334 that must 
5 reflects both blue and red visible wavelengths and an achromatic, long-focus lens 
1336 which corrects for the longer focal length of the fused silica collection lens 
1 306 at visible wavelengths. 

While this invention has been particularly shown and described with 
references to preferred embodiments thereof, it will be understood by those skilled 
10 in the art that various changes in form and details may be made therein without 
departing from the scope of the invention encompassed by the appended claims. 
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CLAIMS 

What is claimed is: 

1 . A fluorescence imaging system comprising: 

a light source for producing excitation light that induces visible 
5 fluorescence in tissue and a reference light; 

an optical combiner that combines said excitation light and said 
reference light onto a common optical path, said combined light being 
coupled into an optical guide that delivers the combined light to the tissue; 
an image sensor that detects a fluorescence image and a reference 
1 0 image of the tissue; and 

a data processor that processes the fluorescence image and said 
reference image to produce a processed output image of the tissue. 

2. The system of Claim 1 wherein the light source is an arc lamp. 

3. The system of Claim 2 wherein the arc lamp current source is a pulsed 
1 5 source. 

4. The system of Claim 1 wherein the optical guide is a removable fiberoptic 
extending through a biopsy channel of an endoscope. 

5. The method of Claim 1 wherein the image sensor is located at a distal end of 
a endoscope. 

20 6. The system of Claim 1 wherein the excitation light and the reference light are 
emitted sequentially such that a monochromatic image sensors detects a 
fluorescent image during a first time period and detects a reflected image 
during a second time period. 
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7. The system of Claim 1 wherein the excitation light and the reference light are 
emitted simultaneously such that respective images are detected by a 
color-sensitive image sensor, a blue channel detecting the fluorescence image 
and a red channel detecting the reference image. 

5 8. The system of Claim 1 wherein the excitation light is in the range of 300 to 420 
nm. 

9. The system of Claim 1 wherein the light source further comprises a reference 
light source having a wavelength in a red or infrared range. 

10. The system of Claim 1 wherein the optical guide comprises an optical fiber with 
10 a distally mounted lens. 

11. The system of Claim 1 wherein the excitation light has an angular orientation 
that is the same as an angular orientation as the reference light. 

12. The system of Claim 1 further comprising a reference illumination of a selected 
wavelength to provide a second reference image. 

15 13. The system of Claim 12 further comprising a light source and a first filter wheel 
that filters light from the light source to provide a first reference illumination 
wavelength and a second illumination wavelength. 

14. The system of Claim 1 further comprising a filter wheel having a filter that 
filters light from the light source to provide fluorescence illumination. 
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15. A method for imaging tissue fluorescence comprising: 

detecting a fluorescence image of tissue and a reference image of the 
tissue; and 

processing said fluorescence image together with said reference image to 
5 produce an output image of the tissue. 

16. The method of Claim 15 further comprising providing an arc lamp light source. 

17. The method of Claim 1 6 further comprising pulsing the arc lamp current source. 

18. The method of Claim 15 further comprising sequentially the images with a 
monochromatic image sensor. 

10 19. The method of Claim 1 5 further comprising detecting images with a color- 
sensitive image sensor, the sensor having a blue channel detecting an 
autofluorescence image and a red channel detecting the reference image. 

20. The method of Claim 15 further comprising coupling excitation light and a 
reference light to an optical fiber such that a variation in a normalized intensity 

15 of the reference light and a normalized intensity of the excitation light is less 

than 20% at any point in a wavefront along the optical path between a combiner 
that combines the excitation light and the reference light. 

21 . A method for imaging tissue fluorescence comprising: 

providing excitation light having a wavelength in a range of 300 nm to 

20 420 nm; 

providing a reference light; 
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combining said excitation light and said reference light onto a common 
optical path such that an intensity of the excitation light varies less than 20% 
relative to a normalized intensity of the reference light at any point along the 
optical path; 

5 detecting a fluorescence image of the tissue due to the said excitation 

light and a reference image of the tissue due to reflected reference light with an 
imaging sensor at a distal end of an endoscopic probe; and 

processing said fluorescence image and said reference image to produce 
an output image of the tissue. 

10 22. The method of Claim 21 further comprising determining a ratio of the 

fluorescence image and the reference image to provide a processed image. 

23. The method of Claim 21 further comprising adjusting the relative intensity or 
angular distribution of the reference light relative to the excitation light. 

24. The method of Claim 21 further comprising detecting first and second reference 
1 5 images having different wavelengths. 

25. The method of Claim 24 further comprising detecting blue and red reference 
images and forming a third reference image from a pixel-by-pixel ratio of the 
blue and red images. 
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